Sep 10 18:14:07 devstack cinder-volume[76867]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 10 18:14:07 devstack cinder-volume[76867]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 10 18:14:07 devstack cinder-volume[76867]: we strongly recommend against using it for new projects. Sep 10 18:14:07 devstack cinder-volume[76867]: If you are already using Eventlet, we recommend migrating to a different Sep 10 18:14:07 devstack cinder-volume[76867]: framework. For more detail see Sep 10 18:14:07 devstack cinder-volume[76867]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 10 18:14:07 devstack cinder-volume[76867]: import eventlet # noqa Sep 10 18:14:09 devstack cinder-volume[76867]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76867) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 18:14:09 devstack cinder-volume[76867]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76867) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 18:14:09 devstack cinder-volume[76867]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76867) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 18:14:10 devstack cinder-volume[76867]: INFO dbcounter [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Registered counter for database cinder Sep 10 18:14:11 devstack cinder-volume[76867]: DEBUG oslo_db.sqlalchemy.engines [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76867) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 18:14:11 devstack cinder-volume[76867]: DEBUG dbcounter [-] [76867] Writer thread running {{(pid=76867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 18:14:11 devstack cinder-volume[76867]: INFO cinder.rpc [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 18:14:11 devstack cinder-volume[76867]: INFO cinder.rpc [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 18:14:11 devstack cinder-volume[76867]: DEBUG oslo_db.sqlalchemy.engines [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76867) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 18:14:11 devstack cinder-volume[76867]: INFO cinder.volume.manager [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Determined volume DB was empty at startup. Sep 10 18:14:11 devstack cinder-volume[76867]: DEBUG cinder.volume.manager [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76867) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 10 18:14:11 devstack cinder-volume[76867]: INFO cinder.volume.manager [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 10 18:14:11 devstack cinder-volume[76867]: WARNING stevedore.named [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 18:14:11 devstack cinder-volume[76867]: WARNING castellan.key_manager [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 18:14:11 devstack cinder-volume[76867]: WARNING cinder.keymgr.conf_key_mgr [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 18:14:11 devstack cinder-volume[76867]: DEBUG cinder.volume.drivers.lvm [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76867) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 10 18:14:11 devstack cinder-volume[76867]: DEBUG oslo_concurrency.processutils [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_concurrency.processutils [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] CMD "cinder-rtstool verify" returned: 0 in 0.443s {{(pid=76867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_db.sqlalchemy.engines [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76867) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 18:14:12 devstack cinder-volume[76867]: INFO cinder.rpc [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 10 18:14:12 devstack cinder-volume[76867]: INFO cinder.rpc [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 10 18:14:12 devstack cinder-volume[76867]: WARNING stevedore.named [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 18:14:12 devstack cinder-volume[76867]: WARNING castellan.key_manager [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 18:14:12 devstack cinder-volume[76867]: INFO cinder.volume.manager [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_db.sqlalchemy.engines [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76867) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 18:14:12 devstack cinder-volume[76867]: INFO oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Starting 1 workers Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Started child 77021 {{(pid=76867) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Full set of CONF: {{(pid=76867) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] ******************************************************************************** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Configuration options gathered from: {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] ================================================================================ {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] allow_availability_zone_fallback = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] allow_compression_on_image_upload = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] allowed_direct_url_schemes = [] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] api_rate_limit = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] auth_strategy = keystone {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] az_cache_duration = 3600 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_availability_zone = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_host = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_name = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_stats_polling_interval = 60 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backup_api_class = cinder.backup.api.API {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backup_name_template = backup-%s {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backup_use_same_host = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backup_use_temp_snapshot = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] chap_password = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] chap_username = {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cinder_internal_tenant_project_id = 769cf154743f422b8aa38d5f58f272b6 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cinder_internal_tenant_user_id = 23b569d9c56044b99a3c5394129c12c8 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cloned_volume_same_az = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[77021]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cluster = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] compression_format = gzip {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] compute_api_class = cinder.compute.nova.API {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] config_dir = [] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] config_source = [] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] control_exchange = openstack {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] debug = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] default_availability_zone = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] default_group_type = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] default_volume_type = lvmdriver-1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] disk_geometry = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] driver_client_cert = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] driver_client_cert_key = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] driver_data_namespace = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] driver_ssl_cert_path = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] driver_ssl_cert_verify = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] driver_use_ssl = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] enable_force_upload = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] enable_new_services = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] enable_unsupported_driver = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] enforce_multipath_for_image_xfer = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] filter_function = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance_api_insecure = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance_api_servers = ['http://192.168.122.159/image'] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance_api_ssl_compression = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance_ca_certificates_file = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance_catalog_info = image:glance:publicURL {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance_certfile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance_keyfile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance_num_retries = 3 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance_request_timeout = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] goodness_function = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] graceful_shutdown_timeout = 5 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] group_api_class = cinder.group.api.API {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] host = devstack {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] image_compress_on_upload = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] image_conversion_address_space_limit = 1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] image_conversion_cpu_limit = 60 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] image_conversion_disable = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] image_upload_use_cinder_backend = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] image_upload_use_internal_tenant = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] image_volume_cache_enabled = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] image_volume_cache_max_count = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] image_volume_cache_max_size_gb = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] init_host_max_objects_retrieval = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] instance_format = [instance: %(uuid)s] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] iscsi_target_flags = {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] iscsi_write_cache = on {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] iser_helper = tgtadm {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] iser_ip_address = 192.168.122.159 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] iser_port = 3260 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] log_color = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] log_config_append = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] log_dir = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] log_file = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] log_options = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] log_rotate_interval = 1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] log_rotate_interval_type = days {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] log_rotation_type = none {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] max_age = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] max_logfile_count = 30 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] max_logfile_size_mb = 200 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] max_over_subscription_ratio = 20.0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] message_reap_interval = 86400 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] message_ttl = 2592000 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] migration_create_volume_timeout_secs = 300 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] monkey_patch = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] monkey_patch_modules = [] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] my_ip = 192.168.122.159 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] no_snapshot_gb_quota = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] num_iser_scan_tries = 3 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] num_shell_tries = 3 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] num_volume_device_scan_tries = 3 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] nvmeof_conn_info_version = 1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] nvmet_ns_id = 10 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] nvmet_port_id = 1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] osapi_max_limit = 1000 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] osapi_volume_ext_list = [] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] osapi_volume_listen_port = 8776 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] osapi_volume_use_ssl = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] osapi_volume_workers = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] per_volume_size_limit = -1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] periodic_fuzzy_delay = 60 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] periodic_interval = 60 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] public_endpoint = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] publish_errors = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[77021]: INFO cinder.volume.manager [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] quota_backup_gigabytes = 1000 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] quota_backups = 10 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] quota_gigabytes = 1000 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] quota_groups = 10 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] quota_snapshots = 10 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] quota_volumes = 10 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] rate_limit_burst = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] rate_limit_except_level = CRITICAL {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] rate_limit_interval = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] reinit_driver_count = 3 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] replication_device = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] report_discard_supported = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] report_interval = 120 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] reservation_clean_interval = 86400 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] reservation_expire = 86400 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] reserved_image_namespaces = [] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] reserved_percentage = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] rpc_response_timeout = 120 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] run_external_periodic_tasks = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] scst_target_driver = iscsi {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] scst_target_iqn_name = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] service_down_time = 720 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] shell_completion = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] snapshot_name_template = snapshot-%s {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] snapshot_same_host = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] split_loggers = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] state_path = /opt/stack/data/cinder {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] storage_availability_zone = nova {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] storage_protocol = iSCSI {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] syslog_log_facility = LOG_USER {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] target_helper = lioadm {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] target_ip_address = 192.168.122.159 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] target_port = 3260 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] target_protocol = iscsi {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] target_secondary_ip_addresses = [] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] trace_flags = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] transport_url = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] until_refresh = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] use_chap_auth = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] use_default_quota_class = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] use_journal = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] use_json = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] use_multipath_for_image_xfer = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] use_stderr = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] use_syslog = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] verify_glance_signatures = enabled {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] volume_api_class = cinder.volume.api.API {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] volume_backend_name = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] volume_clear = zero {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] volume_clear_ionice = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] volume_clear_size = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] volume_copy_bps_limit = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] volume_dd_blocksize = 1M {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] volume_name_template = volume-%s {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] volume_service_inithost_offload = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] volume_usage_audit_period = month {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] zoning_mode = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_concurrency.disable_process_locking = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.auth_section = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.auth_type = password {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.auth_version = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.cache = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.certfile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.include_service_catalog = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.insecure = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.interface = public {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.keyfile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.memcache_password = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.memcache_username = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:12 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.region_name = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.service_type = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.159/identity {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.backend = dogpile.cache.null {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.backend_argument = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.backend_expiration_time = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.config_prefix = cache.oslo {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.debug_cache_backend = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.enable_retry_client = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.enable_socket_keepalive = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.enabled = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.expiration_time = 600 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.hashclient_retry_attempts = 2 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.memcache_dead_retry = 300 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.memcache_pool_maxsize = 10 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.memcache_sasl_enabled = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.password = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.proxies = [] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.redis_db = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.redis_server = localhost:6379 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.retry_attempts = 2 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.retry_delay = 0.0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.socket_keepalive_count = 1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.socket_keepalive_idle = 1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.socket_keepalive_interval = 1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.socket_timeout = 1.0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.tls_allowed_ciphers = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.tls_cafile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.tls_certfile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.tls_enabled = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.tls_keyfile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cache.username = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] coordination.backend_url = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.asyncio_connection = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.asyncio_slave_connection = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.backend = sqlalchemy {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.connection = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.connection_debug = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.connection_parameters = {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.connection_recycle_time = 3600 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.connection_trace = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.db_inc_retry_interval = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.db_max_retries = 20 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.db_max_retry_interval = 10 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.db_retry_interval = 1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.max_overflow = 50 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.max_pool_size = 5 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.max_retries = 10 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.mysql_wsrep_sync_wait = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.pool_timeout = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.retry_interval = 10 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.slave_connection = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.sqlite_synchronous = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.synchronous_reader = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] database.use_db_reconnect = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_tracing.insecure = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] profiler.connection_string = messaging:// {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] profiler.enabled = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] profiler.es_doc_type = notification {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] profiler.es_scroll_size = 10000 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] profiler.es_scroll_time = 2m {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] profiler.filter_error_trace = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] profiler.hmac_keys = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] profiler.sentinel_service_name = mymaster {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] profiler.socket_timeout = 0.1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] profiler.trace_requests = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] profiler.trace_sqlalchemy = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] profiler_jaeger.process_tags = {} {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] profiler_jaeger.service_name_prefix = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack sudo[77025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] profiler_otlp.service_name_prefix = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_policy.enforce_new_defaults = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_policy.policy_default_rule = default {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_policy.policy_file = policy.yaml {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack sudo[77025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] privsep_osbrick.group = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] privsep_osbrick.helper_command = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] privsep_osbrick.user = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cinder_sys_admin.group = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cinder_sys_admin.helper_command = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] cinder_sys_admin.user = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] service_user.auth_section = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] service_user.auth_type = password {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] service_user.cafile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] service_user.certfile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] service_user.collect_timing = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] service_user.insecure = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] service_user.keyfile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] service_user.send_service_user_token = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] service_user.split_loggers = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] service_user.timeout = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] service_user.tls_ciphers = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] service_user.tls_min_version = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance.auth_section = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance.auth_type = password {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance.certfile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance.collect_timing = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance.insecure = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance.keyfile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance.region_name = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance.split_loggers = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance.timeout = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance.tls_ciphers = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] glance.tls_min_version = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.backend_availability_zone = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.chap_password = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.chap_username = {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.disk_geometry = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.driver_client_cert = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.driver_client_cert_key = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.driver_data_namespace = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.driver_use_ssl = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.extra_capabilities = {} {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.filter_function = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.goodness_function = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.iscsi_target_flags = {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.iscsi_write_cache = on {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.iser_helper = tgtadm {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.iser_ip_address = 192.168.122.159 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.iser_port = 3260 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.lvm_share_target = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.lvm_type = auto {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.num_shell_tries = 3 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.replication_device = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.report_discard_supported = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.reserved_percentage = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.target_helper = tgtadm {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.target_ip_address = 192.168.122.159 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.target_port = 3260 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.target_protocol = iscsi {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.trace_flags = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.unique_fqdn_network = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.use_chap_auth = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.volume_backend_name = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.volume_clear = zero {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.volume_clear_ionice = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.volume_clear_size = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_reports.file_event_handler = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_reports.log_dir = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.backend_host = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.chap_password = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.chap_username = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.disk_geometry = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.driver_client_cert = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.extra_capabilities = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.filter_function = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.goodness_function = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.iser_helper = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.iser_ip_address = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.iser_port = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.lvm_share_target = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.lvm_type = auto {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.num_shell_tries = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.replication_device = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.report_discard_supported = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.reserved_percentage = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.scst_target_driver = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.storage_protocol = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.target_helper = lioadm {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.target_ip_address = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.target_port = 3260 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.trace_flags = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.use_chap_auth = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.volume_clear = zero {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.volume_clear_size = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] lvmdriver-1.volumes_dir = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.ssl = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_notifications.driver = [] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_notifications.retry = -1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] key_manager.fixed_key = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican.barbican_api_version = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican.barbican_endpoint = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican.barbican_endpoint_type = public {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican.barbican_region_name = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican.cafile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican.certfile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican.collect_timing = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican.insecure = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican.keyfile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican.number_of_retries = 60 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican.retry_delay = 1 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican.send_service_user_token = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican.split_loggers = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican.timeout = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican.tls_ciphers = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican.tls_min_version = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican.verify_ssl = True {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican.verify_ssl_path = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican_service_user.auth_section = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican_service_user.auth_type = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican_service_user.cafile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican_service_user.certfile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican_service_user.collect_timing = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican_service_user.insecure = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican_service_user.keyfile = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican_service_user.split_loggers = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican_service_user.timeout = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican_service_user.tls_ciphers = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] barbican_service_user.tls_min_version = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] vault.approle_role_id = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] vault.approle_secret_id = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] vault.auth_method = approle {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] vault.auth_path = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] vault.kv_mountpoint = secret {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] vault.kv_path = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] vault.kv_version = 2 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] vault.namespace = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] vault.root_token_id = **** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] vault.ssl_ca_crt_file = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] vault.timeout = 60.0 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] vault.token_file = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] vault.token_role = None {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] vault.use_ssl = False {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:14:12 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] ******************************************************************************** {{(pid=76867) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 10 18:14:12 devstack sudo[77025]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:12 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.406s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:12 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:12 devstack sudo[77033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 18:14:13 devstack sudo[77033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:13 devstack sudo[77033]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:13 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.373s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:13 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:14:13 devstack cinder-volume[77021]: INFO cinder.brick.local_dev.lvm [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 10 18:14:13 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:13 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:13 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:13 devstack sudo[77103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 18:14:13 devstack sudo[77103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:13 devstack sudo[77103]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:13 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:13 devstack cinder-volume[77021]: DEBUG cinder.brick.local_dev.lvm [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77021) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 10 18:14:13 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:13 devstack sudo[77226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 18:14:13 devstack sudo[77226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:14 devstack sudo[77226]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:14 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.535s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:14 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:14 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:14 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:14 devstack sudo[77430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 18:14:14 devstack sudo[77430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:14 devstack sudo[77430]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:14 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:14 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:14 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:14 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:14 devstack sudo[77521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 10 18:14:14 devstack sudo[77521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:14 devstack sudo[77521]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:14 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.322s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:14 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:14 devstack sudo[77640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 18:14:14 devstack sudo[77640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:15 devstack sudo[77640]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:15 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:15 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:15 devstack sudo[77643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 18:14:15 devstack sudo[77643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:15 devstack sudo[77643]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:15 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:15 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:15 devstack sudo[77727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 18:14:15 devstack sudo[77727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:15 devstack sudo[77727]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:15 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:15 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:15 devstack sudo[77730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 18:14:15 devstack sudo[77730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:15 devstack sudo[77730]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:15 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.312s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:15 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:15 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:15 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:16 devstack sudo[77820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 18:14:16 devstack sudo[77820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:16 devstack sudo[77820]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:16 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:16 devstack cinder-volume[77021]: INFO cinder.volume.drivers.lvm [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 10 18:14:16 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:16 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:16 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:16 devstack sudo[77830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 18:14:16 devstack sudo[77830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:16 devstack sudo[77830]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:16 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:16 devstack cinder-volume[77021]: DEBUG cinder.volume.drivers.lvm [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Updating volume stats {{(pid=77021) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 18:14:16 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:16 devstack sudo[77833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 18:14:16 devstack sudo[77833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:16 devstack sudo[77833]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:16 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:16 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:16 devstack sudo[77836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 18:14:16 devstack sudo[77836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:17 devstack sudo[77836]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:17 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:17 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:17 devstack sudo[77839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 18:14:17 devstack sudo[77839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:17 devstack sudo[77839]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:17 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:17 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:17 devstack sudo[77842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 18:14:17 devstack sudo[77842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:17 devstack sudo[77842]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:17 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:17 devstack cinder-volume[77021]: INFO cinder.volume.driver [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Driver hasn't implemented _init_vendor_properties() Sep 10 18:14:17 devstack cinder-volume[77021]: DEBUG cinder.volume.driver [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77021) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 10 18:14:17 devstack cinder-volume[77021]: DEBUG oslo_db.sqlalchemy.engines [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77021) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 18:14:17 devstack cinder-volume[77021]: DEBUG dbcounter [-] [77021] Writer thread running {{(pid=77021) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 18:14:17 devstack cinder-volume[77021]: DEBUG cinder.db.api [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Building query based on filter {{(pid=77021) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 10 18:14:17 devstack cinder-volume[77021]: DEBUG cinder.image.image_utils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77021) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 10 18:14:17 devstack cinder-volume[77021]: INFO cinder.keymgr.migration [None req-6e10dfcc-1b83-4716-b510-43c5695d3f8e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 18:14:17 devstack cinder-volume[77021]: DEBUG cinder.volume.drivers.lvm [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Updating volume stats {{(pid=77021) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 18:14:17 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:17 devstack sudo[77880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 18:14:17 devstack sudo[77880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:18 devstack sudo[77880]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:18 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:18 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:18 devstack sudo[77883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 18:14:18 devstack sudo[77883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:18 devstack sudo[77883]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:18 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:18 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:18 devstack sudo[77888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 18:14:18 devstack sudo[77888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:18 devstack sudo[77888]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:18 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.329s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:18 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:18 devstack sudo[77894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 18:14:18 devstack sudo[77894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:18 devstack sudo[77894]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:18 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:18 devstack cinder-volume[77021]: DEBUG cinder.manager [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Notifying Schedulers of capabilities ... {{(pid=77021) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:14:18 devstack cinder-volume[77021]: INFO cinder.volume.manager [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Driver initialization completed successfully. Sep 10 18:14:18 devstack cinder-volume[77021]: INFO cinder.manager [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Initiating service 2 cleanup Sep 10 18:14:18 devstack cinder-volume[77021]: INFO cinder.manager [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Service 2 cleanup completed. Sep 10 18:14:18 devstack cinder-volume[77021]: DEBUG cinder.service [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Creating RPC server for service cinder-volume {{(pid=77021) start /opt/stack/cinder/cinder/service.py:231}} Sep 10 18:14:19 devstack cinder-volume[77021]: DEBUG cinder.service [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77021) start /opt/stack/cinder/cinder/service.py:237}} Sep 10 18:14:19 devstack cinder-volume[77021]: INFO cinder.volume.manager [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 10 18:14:19 devstack cinder-volume[77021]: DEBUG cinder.volume.drivers.lvm [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Updating volume stats {{(pid=77021) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 18:14:19 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:19 devstack sudo[77897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 18:14:19 devstack sudo[77897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:19 devstack sudo[77897]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:19 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:19 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:19 devstack sudo[77903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 18:14:19 devstack sudo[77903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:19 devstack sudo[77903]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:19 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:19 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:19 devstack sudo[77908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 18:14:19 devstack sudo[77908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:19 devstack sudo[77908]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:19 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:19 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:14:19 devstack sudo[77911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 18:14:19 devstack sudo[77911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:14:20 devstack sudo[77911]: pam_unix(sudo:session): session closed for user root Sep 10 18:14:20 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:14:20 devstack cinder-volume[77021]: INFO cinder.volume.manager [None req-73f3be0d-a7c3-4095-baf7-fde7283668ba None None] Driver post RPC initialization completed successfully. Sep 10 18:14:22 devstack cinder-volume[76867]: DEBUG dbcounter [-] [76867] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:14:30 devstack cinder-volume[77021]: DEBUG dbcounter [-] [77021] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77021) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:14:30 devstack cinder-volume[77021]: DEBUG dbcounter [-] [77021] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=77021) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:15:04 devstack cinder-volume[77021]: DEBUG oslo_service.periodic_task [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Running periodic task VolumeManager._thread_info {{(pid=77021) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:15:04 devstack cinder-volume[77021]: DEBUG cinder.volume.manager [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] thread count: 6 {{(pid=77021) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:15:04 devstack cinder-volume[77021]: DEBUG cinder.volume.manager [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] thread info: [<_MainThread(MainThread, started 129504315580544)>, , , , , ] {{(pid=77021) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:16:04 devstack cinder-volume[77021]: DEBUG oslo_service.periodic_task [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77021) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:16:04 devstack cinder-volume[77021]: DEBUG cinder.volume.drivers.lvm [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Updating volume stats {{(pid=77021) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 18:16:04 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:16:04 devstack sudo[83107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 18:16:04 devstack sudo[83107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:16:04 devstack sudo[83107]: pam_unix(sudo:session): session closed for user root Sep 10 18:16:04 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:16:04 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:16:04 devstack sudo[83110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 18:16:04 devstack sudo[83110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:16:04 devstack sudo[83110]: pam_unix(sudo:session): session closed for user root Sep 10 18:16:04 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:16:04 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:16:04 devstack sudo[83113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 18:16:04 devstack sudo[83113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:16:05 devstack sudo[83113]: pam_unix(sudo:session): session closed for user root Sep 10 18:16:05 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:16:05 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:16:05 devstack sudo[83116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 18:16:05 devstack sudo[83116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:16:05 devstack sudo[83116]: pam_unix(sudo:session): session closed for user root Sep 10 18:16:05 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:16:05 devstack cinder-volume[77021]: DEBUG cinder.manager [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Notifying Schedulers of capabilities ... {{(pid=77021) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:16:05 devstack cinder-volume[77021]: DEBUG oslo_service.periodic_task [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Running periodic task VolumeManager._thread_info {{(pid=77021) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:16:05 devstack cinder-volume[77021]: DEBUG cinder.volume.manager [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] thread count: 6 {{(pid=77021) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:16:05 devstack cinder-volume[77021]: DEBUG cinder.volume.manager [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] thread info: [<_MainThread(MainThread, started 129504315580544)>, , , , , ] {{(pid=77021) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:16:30 devstack cinder-volume[77021]: DEBUG dbcounter [-] [77021] Writing DB stats cinder:SELECT=1 {{(pid=77021) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:16:30 devstack cinder-volume[77021]: DEBUG dbcounter [-] [77021] Writing DB stats cinder:UPDATE=1 {{(pid=77021) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:17:04 devstack cinder-volume[77021]: DEBUG oslo_service.periodic_task [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77021) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:17:04 devstack cinder-volume[77021]: DEBUG cinder.volume.drivers.lvm [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Updating volume stats {{(pid=77021) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 18:17:04 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:17:04 devstack sudo[84835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 18:17:04 devstack sudo[84835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:17:04 devstack sudo[84835]: pam_unix(sudo:session): session closed for user root Sep 10 18:17:04 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:17:04 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:17:04 devstack sudo[84839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 18:17:04 devstack sudo[84839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:17:04 devstack sudo[84839]: pam_unix(sudo:session): session closed for user root Sep 10 18:17:04 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:17:04 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:17:04 devstack sudo[84843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 18:17:04 devstack sudo[84843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:17:05 devstack sudo[84843]: pam_unix(sudo:session): session closed for user root Sep 10 18:17:05 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:17:05 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:17:05 devstack sudo[84855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 18:17:05 devstack sudo[84855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:17:05 devstack sudo[84855]: pam_unix(sudo:session): session closed for user root Sep 10 18:17:05 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:17:05 devstack cinder-volume[77021]: DEBUG cinder.manager [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Notifying Schedulers of capabilities ... {{(pid=77021) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:17:05 devstack cinder-volume[77021]: DEBUG oslo_service.periodic_task [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Running periodic task VolumeManager._thread_info {{(pid=77021) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:17:05 devstack cinder-volume[77021]: DEBUG cinder.volume.manager [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] thread count: 6 {{(pid=77021) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:17:05 devstack cinder-volume[77021]: DEBUG cinder.volume.manager [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] thread info: [<_MainThread(MainThread, started 129504315580544)>, , , , , ] {{(pid=77021) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:18:04 devstack cinder-volume[77021]: DEBUG oslo_service.periodic_task [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77021) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:18:04 devstack cinder-volume[77021]: DEBUG cinder.volume.drivers.lvm [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Updating volume stats {{(pid=77021) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 10 18:18:04 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:18:04 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 18:18:04 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:18:04 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Sep 10 18:18:04 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:18:04 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:18:04 devstack sudo[86230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 18:18:04 devstack sudo[86230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:18:04 devstack sudo[86230]: pam_unix(sudo:session): session closed for user root Sep 10 18:18:04 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:18:04 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:18:04 devstack sudo[86233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 18:18:04 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:18:05 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root Sep 10 18:18:05 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:18:05 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:18:05 devstack sudo[86237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 18:18:05 devstack sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:18:05 devstack sudo[86237]: pam_unix(sudo:session): session closed for user root Sep 10 18:18:05 devstack cinder-volume[77021]: DEBUG oslo_concurrency.processutils [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.238s {{(pid=77021) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:18:05 devstack cinder-volume[77021]: DEBUG cinder.manager [None req-006de10d-5e91-4fb3-9e57-5c4939beda25 None None] Notifying Schedulers of capabilities ... {{(pid=77021) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:18:30 devstack cinder-volume[77021]: DEBUG dbcounter [-] [77021] Writing DB stats cinder:SELECT=1 {{(pid=77021) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:18:30 devstack cinder-volume[77021]: DEBUG dbcounter [-] [77021] Writing DB stats cinder:UPDATE=1 {{(pid=77021) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:18:40 devstack cinder-volume[76867]: INFO oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Caught SIGTERM, stopping children Sep 10 18:18:40 devstack cinder-volume[76867]: DEBUG oslo_concurrency.lockutils [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Acquiring lock "singleton_lock" {{(pid=76867) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 18:18:40 devstack cinder-volume[76867]: DEBUG oslo_concurrency.lockutils [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Acquired lock "singleton_lock" {{(pid=76867) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 18:18:40 devstack cinder-volume[76867]: DEBUG oslo_concurrency.lockutils [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Releasing lock "singleton_lock" {{(pid=76867) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 18:18:40 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Stop services. {{(pid=76867) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 10 18:18:40 devstack cinder-volume[76867]: DEBUG oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Killing children. {{(pid=76867) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 10 18:18:40 devstack cinder-volume[76867]: INFO oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Waiting on 1 children to exit Sep 10 18:18:44 devstack cinder-volume[77021]: DEBUG oslo_concurrency.lockutils [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Acquiring lock "singleton_lock" {{(pid=77021) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 18:18:44 devstack cinder-volume[77021]: DEBUG oslo_concurrency.lockutils [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Acquired lock "singleton_lock" {{(pid=77021) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 18:18:44 devstack cinder-volume[77021]: DEBUG oslo_concurrency.lockutils [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Releasing lock "singleton_lock" {{(pid=77021) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 18:18:44 devstack cinder-volume[77021]: WARNING amqp [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 18:18:44 devstack cinder-volume[77021]: WARNING amqp [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 18:18:44 devstack cinder-volume[76867]: INFO oslo_service.backend._eventlet.service [None req-5139088c-7150-417a-8ccb-c181dace7a19 None None] Child 77021 exited with status 0 Sep 10 18:18:44 devstack cinder-volume[87038]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 10 18:18:44 devstack cinder-volume[87038]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 10 18:18:44 devstack cinder-volume[87038]: we strongly recommend against using it for new projects. Sep 10 18:18:44 devstack cinder-volume[87038]: If you are already using Eventlet, we recommend migrating to a different Sep 10 18:18:44 devstack cinder-volume[87038]: framework. For more detail see Sep 10 18:18:44 devstack cinder-volume[87038]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 10 18:18:44 devstack cinder-volume[87038]: import eventlet # noqa Sep 10 18:18:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87038) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 18:18:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87038) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 18:18:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87038) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 18:18:47 devstack cinder-volume[87038]: INFO dbcounter [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Registered counter for database cinder Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_db.sqlalchemy.engines [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87038) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writer thread running {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 18:18:47 devstack cinder-volume[87038]: INFO cinder.rpc [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 18:18:47 devstack cinder-volume[87038]: INFO cinder.rpc [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_db.sqlalchemy.engines [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87038) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 18:18:47 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Determined volume DB was empty at startup. Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87038) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 10 18:18:47 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 10 18:18:47 devstack cinder-volume[87038]: WARNING stevedore.named [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 18:18:47 devstack cinder-volume[87038]: WARNING castellan.key_manager [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 18:18:47 devstack cinder-volume[87038]: WARNING cinder.keymgr.conf_key_mgr [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 18:18:47 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_db.sqlalchemy.engines [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87038) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 18:18:47 devstack cinder-volume[87038]: INFO oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Starting 1 workers Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Started child 87254 {{(pid=87038) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Full set of CONF: {{(pid=87038) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] ******************************************************************************** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Configuration options gathered from: {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] ================================================================================ {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] allow_availability_zone_fallback = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] allow_compression_on_image_upload = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] allowed_direct_url_schemes = [] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] api_rate_limit = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] auth_strategy = keystone {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_availability_zone = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_host = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_name = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_stats_polling_interval = 60 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backup_api_class = cinder.backup.api.API {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backup_name_template = backup-%s {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backup_use_same_host = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backup_use_temp_snapshot = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] chap_password = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] chap_username = {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cinder_internal_tenant_project_id = 769cf154743f422b8aa38d5f58f272b6 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cinder_internal_tenant_user_id = 23b569d9c56044b99a3c5394129c12c8 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87254]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cluster = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] compression_format = gzip {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] compute_api_class = cinder.compute.nova.API {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] config_dir = [] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] config_source = [] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] control_exchange = openstack {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] debug = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] default_availability_zone = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] default_group_type = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] default_volume_type = QuobyteHD {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] disk_geometry = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] driver_client_cert = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] driver_client_cert_key = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] driver_data_namespace = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] driver_ssl_cert_path = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] driver_ssl_cert_verify = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] driver_use_ssl = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] enable_new_services = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] enable_unsupported_driver = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] enabled_backends = ['QuobyteHD'] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] enforce_multipath_for_image_xfer = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] filter_function = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance_api_insecure = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance_api_servers = ['http://192.168.122.159/image'] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance_api_ssl_compression = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance_ca_certificates_file = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance_catalog_info = image:glance:publicURL {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance_certfile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance_keyfile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance_num_retries = 3 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance_request_timeout = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] goodness_function = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] graceful_shutdown_timeout = 5 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] group_api_class = cinder.group.api.API {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] host = devstack {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] image_compress_on_upload = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] image_conversion_address_space_limit = 1 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] image_conversion_cpu_limit = 60 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] image_conversion_disable = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] image_upload_use_cinder_backend = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] image_upload_use_internal_tenant = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] image_volume_cache_enabled = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] image_volume_cache_max_count = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] image_volume_cache_max_size_gb = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] init_host_max_objects_retrieval = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] instance_format = [instance: %(uuid)s] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] iscsi_target_flags = {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] iscsi_write_cache = on {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] iser_helper = tgtadm {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] iser_ip_address = 192.168.122.159 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] iser_port = 3260 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] log_color = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] log_config_append = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] log_dir = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] log_file = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] log_options = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] log_rotate_interval = 1 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] log_rotate_interval_type = days {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] log_rotation_type = none {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] max_age = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] max_logfile_count = 30 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] max_logfile_size_mb = 200 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] max_over_subscription_ratio = 20.0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] message_reap_interval = 86400 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] message_ttl = 2592000 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] migration_create_volume_timeout_secs = 300 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] monkey_patch = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] monkey_patch_modules = [] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] my_ip = 192.168.122.159 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] no_snapshot_gb_quota = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] num_iser_scan_tries = 3 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] num_shell_tries = 3 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] num_volume_device_scan_tries = 3 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] nvmeof_conn_info_version = 1 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] nvmet_ns_id = 10 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] nvmet_port_id = 1 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] osapi_max_limit = 1000 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] osapi_volume_ext_list = [] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] osapi_volume_listen = 0.0.0.0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] osapi_volume_listen_port = 8776 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] osapi_volume_use_ssl = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] osapi_volume_workers = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] per_volume_size_limit = -1 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] periodic_fuzzy_delay = 60 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] periodic_interval = 60 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] project_id_regex = [0-9a-f\-]+ {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] public_endpoint = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] publish_errors = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] quota_backup_gigabytes = 1000 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] quota_backups = 10 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] quota_gigabytes = 1000 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:47 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] quota_groups = 10 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] quota_snapshots = 10 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] quota_volumes = 10 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] rate_limit_burst = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] rate_limit_except_level = CRITICAL {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] rate_limit_interval = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] reinit_driver_count = 3 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] replication_device = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] report_discard_supported = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] report_interval = 120 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] reservation_clean_interval = 86400 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] reservation_expire = 86400 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] reserved_image_namespaces = [] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] reserved_percentage = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] rpc_response_timeout = 120 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] run_external_periodic_tasks = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] scst_target_driver = iscsi {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] scst_target_iqn_name = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] service_down_time = 720 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] shell_completion = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] snapshot_name_template = snapshot-%s {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] split_loggers = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] state_path = /opt/stack/data/cinder {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] storage_availability_zone = nova {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] storage_protocol = iSCSI {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] syslog_log_facility = LOG_USER {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] target_helper = lioadm {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] target_ip_address = 192.168.122.159 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] target_port = 3260 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] target_protocol = iscsi {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] target_secondary_ip_addresses = [] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] trace_flags = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] transfer_api_class = cinder.transfer.api.API {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] transport_url = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] until_refresh = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] use_chap_auth = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] use_default_quota_class = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] use_journal = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] use_json = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] use_multipath_for_image_xfer = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] use_stderr = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] use_syslog = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] verify_glance_signatures = enabled {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] volume_api_class = cinder.volume.api.API {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] volume_backend_name = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87254]: INFO cinder.volume.manager [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] volume_clear = zero {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87254]: DEBUG cinder.volume.drivers.remotefs [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87254) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] volume_clear_ionice = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] volume_clear_size = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] volume_copy_bps_limit = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] volume_dd_blocksize = 1M {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] volume_name_template = volume-%s {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] volume_service_inithost_offload = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] volume_usage_audit_period = month {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] zoning_mode = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_concurrency.disable_process_locking = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.auth_section = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.auth_type = password {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.auth_version = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.cache = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.certfile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.delay_auth_decision = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.http_connect_timeout = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.include_service_catalog = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.insecure = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.interface = public {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.keyfile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.memcache_password = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.memcache_username = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.region_name = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.service_token_roles_required = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.service_type = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.token_cache_time = 300 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.159/identity {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.backend = dogpile.cache.null {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.backend_argument = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.backend_expiration_time = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.config_prefix = cache.oslo {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.debug_cache_backend = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.enable_retry_client = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.enable_socket_keepalive = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.enabled = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.expiration_time = 600 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.hashclient_retry_attempts = 2 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.memcache_dead_retry = 300 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.memcache_pool_maxsize = 10 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.memcache_sasl_enabled = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.password = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.proxies = [] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.redis_db = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.redis_sentinel_service_name = mymaster {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.redis_server = localhost:6379 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.retry_attempts = 2 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.retry_delay = 0.0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.socket_keepalive_count = 1 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.socket_keepalive_idle = 1 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.socket_keepalive_interval = 1 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.socket_timeout = 1.0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.tls_allowed_ciphers = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.tls_cafile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.tls_certfile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.tls_enabled = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.tls_keyfile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cache.username = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] coordination.backend_url = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.asyncio_connection = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.asyncio_slave_connection = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.backend = sqlalchemy {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.connection = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.connection_debug = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.connection_parameters = {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.connection_recycle_time = 3600 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.connection_trace = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.db_inc_retry_interval = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.db_max_retries = 20 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.db_max_retry_interval = 10 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.db_retry_interval = 1 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.max_overflow = 50 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.max_pool_size = 5 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.max_retries = 10 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.mysql_wsrep_sync_wait = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.pool_timeout = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.retry_interval = 10 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.slave_connection = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.sqlite_synchronous = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.synchronous_reader = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] database.use_db_reconnect = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_tracing.insecure = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] profiler.connection_string = messaging:// {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] profiler.enabled = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] profiler.es_doc_type = notification {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] profiler.es_scroll_size = 10000 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] profiler.es_scroll_time = 2m {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] profiler.filter_error_trace = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] profiler.hmac_keys = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] profiler.sentinel_service_name = mymaster {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] profiler.socket_timeout = 0.1 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] profiler.trace_requests = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] profiler.trace_sqlalchemy = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] profiler_jaeger.process_tags = {} {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] profiler_jaeger.service_name_prefix = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] profiler_otlp.service_name_prefix = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_policy.enforce_new_defaults = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_policy.policy_default_rule = default {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_policy.policy_file = policy.yaml {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_policy.remote_timeout = 60.0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] privsep_osbrick.group = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] privsep_osbrick.helper_command = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87254]: DEBUG cinder.volume.drivers.quobyte [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87254) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] privsep_osbrick.user = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87254]: WARNING cinder.volume.drivers.quobyte [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 10 18:18:48 devstack cinder-volume[87254]: WARNING cinder.volume.drivers.quobyte [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cinder_sys_admin.group = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cinder_sys_admin.helper_command = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] cinder_sys_admin.user = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87254]: DEBUG oslo_concurrency.processutils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Running cmd (subprocess): mount.quobyte {{(pid=87254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] service_user.auth_section = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] service_user.auth_type = password {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] service_user.cafile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] service_user.certfile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] service_user.collect_timing = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] service_user.insecure = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] service_user.keyfile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] service_user.send_service_user_token = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] service_user.split_loggers = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] service_user.timeout = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] service_user.tls_ciphers = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] service_user.tls_min_version = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance.auth_section = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance.auth_type = password {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance.certfile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance.collect_timing = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance.insecure = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance.keyfile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance.region_name = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance.split_loggers = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance.timeout = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance.tls_ciphers = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] glance.tls_min_version = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.backend_availability_zone = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.chap_password = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.chap_username = {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.disk_geometry = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.driver_client_cert = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.driver_client_cert_key = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.driver_data_namespace = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.driver_use_ssl = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.enable_unsupported_driver = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.extra_capabilities = {} {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.filter_function = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.goodness_function = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.iscsi_target_flags = {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.iscsi_write_cache = on {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.iser_helper = tgtadm {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.iser_ip_address = 192.168.122.159 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.iser_port = 3260 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.nas_host = {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.nas_login = admin {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.nas_mount_options = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.nas_password = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.nas_private_key = {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.nas_share_path = {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.nas_ssh_port = 22 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.num_shell_tries = 3 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.nvmet_port_id = 1 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.quobyte_client_cfg = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.quobyte_volume_url = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.replication_device = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.report_discard_supported = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.reserved_percentage = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.scst_target_driver = iscsi {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.scst_target_iqn_name = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.storage_protocol = iSCSI {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.target_helper = tgtadm {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.target_ip_address = 192.168.122.159 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.target_port = 3260 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.target_protocol = iscsi {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.trace_flags = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.unique_fqdn_network = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.use_chap_auth = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.volume_backend_name = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.volume_clear = zero {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.volume_clear_ionice = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.volume_clear_size = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_reports.file_event_handler = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_reports.log_dir = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.backend_availability_zone = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.backend_host = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.chap_password = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.chap_username = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.chiscsi_conf = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.disk_geometry = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.driver_client_cert = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.driver_client_cert_key = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.driver_data_namespace = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.driver_use_ssl = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.extra_capabilities = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.filter_function = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.goodness_function = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.iscsi_target_flags = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.iscsi_write_cache = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.iser_helper = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.iser_ip_address = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.iser_port = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.iser_target_prefix = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.nas_host = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.nas_login = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.nas_mount_options = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.nas_password = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.nas_private_key = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.nas_share_path = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.nas_ssh_port = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.num_shell_tries = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.nvmet_ns_id = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.nvmet_port_id = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.replication_device = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.report_discard_supported = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.reserved_percentage = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.scst_target_driver = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.storage_protocol = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.target_helper = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack quobyte-client[87258]: Reading configuration file: /etc/quobyte/client.cfg Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.target_ip_address = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.target_port = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.target_prefix = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.target_protocol = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.trace_flags = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.unique_fqdn_network = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack quobyte-client[87258]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 10 18:18:48 devstack cinder-volume[87254]: DEBUG oslo_concurrency.processutils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] CMD "mount.quobyte" returned: 1 in 0.134s {{(pid=87254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:18:48 devstack cinder-volume[87254]: DEBUG oslo_concurrency.lockutils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:18:48 devstack cinder-volume[87254]: DEBUG oslo_concurrency.lockutils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:18:48 devstack cinder-volume[87254]: DEBUG cinder.volume.drivers.quobyte [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87254) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.use_chap_auth = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.volume_clear = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87254]: INFO cinder.volume.drivers.quobyte [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 ... Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.volume_clear_ionice = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.volume_clear_size = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87254]: DEBUG oslo_concurrency.processutils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 -c /etc/quobyte/client-cinder.cfg {{(pid=87254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] QuobyteHD.volumes_dir = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.ssl = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.ssl_version = {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack sudo[87266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 -c /etc/quobyte/client-cinder.cfg Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_notifications.driver = [] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_notifications.retry = -1 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] oslo_messaging_notifications.transport_url = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] key_manager.fixed_key = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican.barbican_api_version = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican.barbican_endpoint = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican.barbican_endpoint_type = public {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican.barbican_region_name = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican.cafile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican.certfile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican.collect_timing = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican.insecure = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican.keyfile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican.number_of_retries = 60 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican.retry_delay = 1 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican.send_service_user_token = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican.split_loggers = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican.timeout = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican.tls_ciphers = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican.tls_min_version = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican.verify_ssl = True {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican.verify_ssl_path = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican_service_user.auth_section = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican_service_user.auth_type = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican_service_user.cafile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican_service_user.certfile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican_service_user.collect_timing = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican_service_user.insecure = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican_service_user.keyfile = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican_service_user.split_loggers = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican_service_user.timeout = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican_service_user.tls_ciphers = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] barbican_service_user.tls_min_version = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] vault.approle_role_id = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] vault.approle_secret_id = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] vault.auth_method = approle {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] vault.auth_path = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] vault.kv_mountpoint = secret {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] vault.kv_path = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] vault.kv_version = 2 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] vault.namespace = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] vault.root_token_id = **** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] vault.ssl_ca_crt_file = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] vault.timeout = 60.0 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] vault.token_file = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] vault.token_role = None {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] vault.use_ssl = False {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:18:48 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] ******************************************************************************** {{(pid=87038) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 10 18:18:48 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root Sep 10 18:18:48 devstack cinder-volume[87254]: DEBUG oslo_concurrency.processutils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.408s {{(pid=87254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:18:48 devstack cinder-volume[87254]: INFO cinder.volume.drivers.quobyte [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 succeeded Sep 10 18:18:48 devstack cinder-volume[87254]: DEBUG cinder.volume.drivers.quobyte [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87254) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:18:48 devstack cinder-volume[87254]: DEBUG oslo_concurrency.lockutils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.429s {{(pid=87254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:18:48 devstack cinder-volume[87254]: DEBUG oslo_concurrency.processutils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:18:48 devstack sudo[87336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:18:48 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:18:48 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root Sep 10 18:18:48 devstack cinder-volume[87254]: DEBUG oslo_concurrency.processutils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.246s {{(pid=87254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:18:48 devstack cinder-volume[87254]: INFO cinder.volume.driver [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Driver hasn't implemented _init_vendor_properties() Sep 10 18:18:48 devstack cinder-volume[87254]: DEBUG cinder.volume.driver [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2224044799805, 'free_capacity_gb': 1773.2224044799805, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87254) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG oslo_db.sqlalchemy.engines [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87254) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG dbcounter [-] [87254] Writer thread running {{(pid=87254) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG cinder.db.api [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Building query based on filter {{(pid=87254) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG cinder.image.image_utils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87254) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 10 18:18:49 devstack cinder-volume[87254]: INFO cinder.keymgr.migration [None req-469b1af4-6c66-4a7a-a43e-46709481ee2c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG oslo_concurrency.lockutils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG oslo_concurrency.lockutils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG cinder.volume.drivers.quobyte [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87254) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG cinder.volume.drivers.quobyte [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87254) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG oslo_concurrency.lockutils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG oslo_concurrency.processutils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:18:49 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:18:49 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:18:49 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG oslo_concurrency.processutils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.239s {{(pid=87254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG cinder.manager [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Notifying Schedulers of capabilities ... {{(pid=87254) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:18:49 devstack cinder-volume[87254]: INFO cinder.volume.manager [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Driver initialization completed successfully. Sep 10 18:18:49 devstack cinder-volume[87254]: INFO cinder.manager [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Initiating service 3 cleanup Sep 10 18:18:49 devstack cinder-volume[87254]: INFO cinder.manager [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Service 3 cleanup completed. Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG cinder.service [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Creating RPC server for service cinder-volume {{(pid=87254) start /opt/stack/cinder/cinder/service.py:231}} Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG cinder.service [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87254) start /opt/stack/cinder/cinder/service.py:237}} Sep 10 18:18:49 devstack cinder-volume[87254]: INFO cinder.volume.manager [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG oslo_concurrency.lockutils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG oslo_concurrency.lockutils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG cinder.volume.drivers.quobyte [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87254) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG cinder.volume.drivers.quobyte [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87254) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG oslo_concurrency.lockutils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG oslo_concurrency.processutils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:18:49 devstack sudo[87342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:18:49 devstack sudo[87342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:18:49 devstack sudo[87342]: pam_unix(sudo:session): session closed for user root Sep 10 18:18:49 devstack cinder-volume[87254]: DEBUG oslo_concurrency.processutils [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.238s {{(pid=87254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:18:49 devstack cinder-volume[87254]: INFO cinder.volume.manager [None req-0daa6f01-bb6f-4bd9-abdd-f52d3c9f7f57 None None] Driver post RPC initialization completed successfully. Sep 10 18:18:54 devstack cinder-volume[87254]: DEBUG oslo_concurrency.lockutils [None req-ee6a2569-908a-4c99-8ed9-8ca91ebaf8dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:18:54 devstack cinder-volume[87254]: DEBUG oslo_concurrency.lockutils [None req-ee6a2569-908a-4c99-8ed9-8ca91ebaf8dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:18:54 devstack cinder-volume[87254]: DEBUG cinder.volume.drivers.quobyte [None req-ee6a2569-908a-4c99-8ed9-8ca91ebaf8dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87254) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:18:54 devstack cinder-volume[87254]: DEBUG cinder.volume.drivers.quobyte [None req-ee6a2569-908a-4c99-8ed9-8ca91ebaf8dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87254) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:18:54 devstack cinder-volume[87254]: DEBUG oslo_concurrency.lockutils [None req-ee6a2569-908a-4c99-8ed9-8ca91ebaf8dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:18:54 devstack cinder-volume[87254]: DEBUG oslo_concurrency.processutils [None req-ee6a2569-908a-4c99-8ed9-8ca91ebaf8dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:18:54 devstack sudo[87527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:18:54 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:18:54 devstack cinder-volume[87038]: INFO oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Caught SIGTERM, stopping children Sep 10 18:18:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Acquiring lock "singleton_lock" {{(pid=87038) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 18:18:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Acquired lock "singleton_lock" {{(pid=87038) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 18:18:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Releasing lock "singleton_lock" {{(pid=87038) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 18:18:54 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Stop services. {{(pid=87038) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 10 18:18:54 devstack cinder-volume[87038]: DEBUG oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Killing children. {{(pid=87038) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 10 18:18:54 devstack cinder-volume[87038]: INFO oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Waiting on 1 children to exit Sep 10 18:18:54 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root Sep 10 18:18:54 devstack cinder-volume[87254]: DEBUG oslo_concurrency.processutils [None req-ee6a2569-908a-4c99-8ed9-8ca91ebaf8dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.275s {{(pid=87254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:18:54 devstack cinder-volume[87254]: DEBUG cinder.manager [None req-ee6a2569-908a-4c99-8ed9-8ca91ebaf8dd None None] Notifying Schedulers of capabilities ... {{(pid=87254) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ee6a2569-908a-4c99-8ed9-8ca91ebaf8dd None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ee6a2569-908a-4c99-8ed9-8ca91ebaf8dd None None] Unable to connect to AMQP server on 192.168.122.159:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server [None req-ee6a2569-908a-4c99-8ed9-8ca91ebaf8dd None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.159:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server method() Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server self._producer.publish( Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server return _publish( Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server listener(*args) Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server raise error_for_code( Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server self.transport._send( Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.159:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 10 18:18:54 devstack cinder-volume[87254]: ERROR oslo_messaging.rpc.server Sep 10 18:18:57 devstack cinder-volume[87254]: DEBUG oslo_concurrency.lockutils [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Acquiring lock "singleton_lock" {{(pid=87254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 18:18:57 devstack cinder-volume[87254]: DEBUG oslo_concurrency.lockutils [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Acquired lock "singleton_lock" {{(pid=87254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 18:18:57 devstack cinder-volume[87254]: DEBUG oslo_concurrency.lockutils [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Releasing lock "singleton_lock" {{(pid=87254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 18:18:57 devstack cinder-volume[87254]: WARNING amqp [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 18:18:57 devstack cinder-volume[87254]: WARNING amqp [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 18:18:57 devstack cinder-volume[87038]: INFO oslo_service.backend._eventlet.service [None req-a3382d0e-1b50-4846-a2c5-4a1a170d063c None None] Child 87254 exited with status 0 Sep 10 18:18:58 devstack cinder-volume[87543]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 10 18:18:58 devstack cinder-volume[87543]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 10 18:18:58 devstack cinder-volume[87543]: we strongly recommend against using it for new projects. Sep 10 18:18:58 devstack cinder-volume[87543]: If you are already using Eventlet, we recommend migrating to a different Sep 10 18:18:58 devstack cinder-volume[87543]: framework. For more detail see Sep 10 18:18:58 devstack cinder-volume[87543]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 10 18:18:58 devstack cinder-volume[87543]: import eventlet # noqa Sep 10 18:19:01 devstack cinder-volume[87543]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87543) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 10 18:19:01 devstack cinder-volume[87543]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87543) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 10 18:19:01 devstack cinder-volume[87543]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87543) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 10 18:19:01 devstack cinder-volume[87543]: INFO dbcounter [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] Registered counter for database cinder Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_db.sqlalchemy.engines [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87543) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG dbcounter [-] [87543] Writer thread running {{(pid=87543) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 18:19:02 devstack cinder-volume[87543]: INFO cinder.rpc [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 18:19:02 devstack cinder-volume[87543]: INFO cinder.rpc [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_db.sqlalchemy.engines [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87543) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 18:19:02 devstack cinder-volume[87543]: INFO cinder.volume.manager [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] Determined volume DB was empty at startup. Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG cinder.volume.manager [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87543) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 10 18:19:02 devstack cinder-volume[87543]: WARNING stevedore.named [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 18:19:02 devstack cinder-volume[87543]: WARNING castellan.key_manager [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 18:19:02 devstack cinder-volume[87543]: WARNING cinder.keymgr.conf_key_mgr [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 18:19:02 devstack cinder-volume[87543]: INFO cinder.volume.manager [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_db.sqlalchemy.engines [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87543) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 18:19:02 devstack cinder-volume[87543]: INFO oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] Starting 1 workers Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] Started child 87842 {{(pid=87543) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] Full set of CONF: {{(pid=87543) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] ******************************************************************************** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] Configuration options gathered from: {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] ================================================================================ {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 10 18:19:02 devstack cinder-volume[87842]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] allow_availability_zone_fallback = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] allow_compression_on_image_upload = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] allowed_direct_url_schemes = [] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] api_rate_limit = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] auth_strategy = keystone {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_availability_zone = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_host = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_name = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_stats_polling_interval = 60 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backup_api_class = cinder.backup.api.API {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backup_name_template = backup-%s {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backup_use_same_host = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backup_use_temp_snapshot = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] chap_password = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] chap_username = {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cinder_internal_tenant_project_id = 769cf154743f422b8aa38d5f58f272b6 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cinder_internal_tenant_user_id = 23b569d9c56044b99a3c5394129c12c8 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cluster = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] compression_format = gzip {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] compute_api_class = cinder.compute.nova.API {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] config_dir = [] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] config_source = [] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] control_exchange = openstack {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] debug = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] default_availability_zone = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] default_group_type = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] default_volume_type = QuobyteHD {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] disk_geometry = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] driver_client_cert = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] driver_client_cert_key = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] driver_data_namespace = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] driver_ssl_cert_path = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] driver_ssl_cert_verify = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] driver_use_ssl = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] enable_new_services = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] enable_unsupported_driver = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] enabled_backends = ['QuobyteHD'] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] enforce_multipath_for_image_xfer = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] filter_function = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance_api_insecure = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance_api_servers = ['http://192.168.122.159/image'] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance_api_ssl_compression = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance_ca_certificates_file = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance_catalog_info = image:glance:publicURL {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance_certfile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance_keyfile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance_num_retries = 3 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance_request_timeout = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] goodness_function = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] graceful_shutdown_timeout = 5 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] group_api_class = cinder.group.api.API {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] host = devstack {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] image_compress_on_upload = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] image_conversion_address_space_limit = 1 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] image_conversion_cpu_limit = 60 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] image_conversion_disable = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] image_upload_use_cinder_backend = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] image_upload_use_internal_tenant = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] image_volume_cache_enabled = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] image_volume_cache_max_count = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] image_volume_cache_max_size_gb = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] init_host_max_objects_retrieval = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] instance_format = [instance: %(uuid)s] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] iscsi_target_flags = {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] iscsi_write_cache = on {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] iser_helper = tgtadm {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] iser_ip_address = 192.168.122.159 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] iser_port = 3260 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] log_color = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] log_config_append = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] log_dir = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] log_file = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] log_options = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] log_rotate_interval = 1 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] log_rotate_interval_type = days {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] log_rotation_type = none {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] max_age = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] max_logfile_count = 30 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] max_logfile_size_mb = 200 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] max_over_subscription_ratio = 20.0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87842) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] message_reap_interval = 86400 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] message_ttl = 2592000 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] migration_create_volume_timeout_secs = 300 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] monkey_patch = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] monkey_patch_modules = [] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] my_ip = 192.168.122.159 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] no_snapshot_gb_quota = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] num_iser_scan_tries = 3 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] num_shell_tries = 3 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] num_volume_device_scan_tries = 3 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] nvmeof_conn_info_version = 1 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] nvmet_ns_id = 10 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] nvmet_port_id = 1 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] osapi_max_limit = 1000 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] osapi_volume_ext_list = [] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] osapi_volume_listen_port = 8776 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] osapi_volume_use_ssl = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] osapi_volume_workers = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] per_volume_size_limit = -1 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] periodic_fuzzy_delay = 60 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] periodic_interval = 60 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] public_endpoint = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] publish_errors = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] quota_backup_gigabytes = 1000 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] quota_backups = 10 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] quota_gigabytes = 1000 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] quota_groups = 10 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] quota_snapshots = 10 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] quota_volumes = 10 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] rate_limit_burst = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] rate_limit_except_level = CRITICAL {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] rate_limit_interval = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] reinit_driver_count = 3 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] replication_device = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] report_discard_supported = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] report_interval = 120 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] reservation_clean_interval = 86400 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] reservation_expire = 86400 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] reserved_image_namespaces = [] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] reserved_percentage = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] rpc_response_timeout = 120 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] run_external_periodic_tasks = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] scst_target_driver = iscsi {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] scst_target_iqn_name = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] service_down_time = 720 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] shell_completion = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] snapshot_name_template = snapshot-%s {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] split_loggers = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] state_path = /opt/stack/data/cinder {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] storage_availability_zone = nova {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] storage_protocol = iSCSI {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] syslog_log_facility = LOG_USER {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] target_helper = lioadm {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] target_ip_address = 192.168.122.159 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] target_port = 3260 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] target_protocol = iscsi {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] target_secondary_ip_addresses = [] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] trace_flags = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] transport_url = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] until_refresh = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] use_chap_auth = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] use_default_quota_class = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] use_journal = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] use_json = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] use_multipath_for_image_xfer = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] use_stderr = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] use_syslog = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] verify_glance_signatures = enabled {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] volume_api_class = cinder.volume.api.API {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] volume_backend_name = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] volume_clear = zero {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] volume_clear_ionice = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] volume_clear_size = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] volume_copy_bps_limit = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] volume_dd_blocksize = 1M {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] volume_name_template = volume-%s {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] volume_service_inithost_offload = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] volume_usage_audit_period = month {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] zoning_mode = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_concurrency.disable_process_locking = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.auth_section = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.auth_type = password {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.auth_version = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.cache = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.certfile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.include_service_catalog = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.insecure = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.interface = public {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.keyfile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.memcache_password = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.memcache_username = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.region_name = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.service_type = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.159/identity {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.backend = dogpile.cache.null {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.backend_argument = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.backend_expiration_time = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.config_prefix = cache.oslo {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.debug_cache_backend = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.enable_retry_client = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.enable_socket_keepalive = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.enabled = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.expiration_time = 600 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.hashclient_retry_attempts = 2 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.memcache_dead_retry = 300 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.memcache_pool_maxsize = 10 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.memcache_sasl_enabled = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.password = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.proxies = [] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.redis_db = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.redis_server = localhost:6379 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.retry_attempts = 2 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.retry_delay = 0.0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.socket_keepalive_count = 1 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.socket_keepalive_idle = 1 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.socket_keepalive_interval = 1 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.socket_timeout = 1.0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.tls_allowed_ciphers = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.tls_cafile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.tls_certfile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.tls_enabled = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.tls_keyfile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cache.username = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] coordination.backend_url = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.asyncio_connection = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.asyncio_slave_connection = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.backend = sqlalchemy {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.connection = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.connection_debug = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.connection_parameters = {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.connection_recycle_time = 3600 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.connection_trace = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.db_inc_retry_interval = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.db_max_retries = 20 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.db_max_retry_interval = 10 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.db_retry_interval = 1 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.max_overflow = 50 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.max_pool_size = 5 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.max_retries = 10 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.mysql_wsrep_sync_wait = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.pool_timeout = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.retry_interval = 10 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.slave_connection = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.sqlite_synchronous = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.synchronous_reader = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] database.use_db_reconnect = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_tracing.insecure = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] profiler.connection_string = messaging:// {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] profiler.enabled = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] profiler.es_doc_type = notification {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] profiler.es_scroll_size = 10000 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] profiler.es_scroll_time = 2m {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] profiler.filter_error_trace = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] profiler.hmac_keys = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] profiler.sentinel_service_name = mymaster {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] profiler.socket_timeout = 0.1 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] profiler.trace_requests = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] profiler.trace_sqlalchemy = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] profiler_jaeger.process_tags = {} {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] profiler_jaeger.service_name_prefix = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] profiler_otlp.service_name_prefix = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_policy.enforce_new_defaults = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_policy.policy_default_rule = default {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_policy.policy_file = policy.yaml {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] privsep_osbrick.group = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] privsep_osbrick.helper_command = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] privsep_osbrick.user = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cinder_sys_admin.group = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cinder_sys_admin.helper_command = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] cinder_sys_admin.user = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] service_user.auth_section = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] service_user.auth_type = password {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] service_user.cafile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] service_user.certfile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] service_user.collect_timing = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] service_user.insecure = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] service_user.keyfile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] service_user.send_service_user_token = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] service_user.split_loggers = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] service_user.timeout = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] service_user.tls_ciphers = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] service_user.tls_min_version = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance.auth_section = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance.auth_type = password {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance.certfile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance.collect_timing = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance.insecure = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance.keyfile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance.region_name = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance.split_loggers = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance.timeout = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance.tls_ciphers = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] glance.tls_min_version = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.backend_availability_zone = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.chap_password = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.chap_username = {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.disk_geometry = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.driver_client_cert = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.driver_client_cert_key = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.driver_data_namespace = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.driver_use_ssl = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.extra_capabilities = {} {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.filter_function = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.goodness_function = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.iscsi_target_flags = {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.iscsi_write_cache = on {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.iser_helper = tgtadm {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.iser_ip_address = 192.168.122.159 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.iser_port = 3260 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.nas_host = {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.nas_login = admin {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.nas_mount_options = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.nas_password = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.nas_private_key = {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.nas_share_path = {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.num_shell_tries = 3 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.quobyte_volume_url = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.replication_device = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.report_discard_supported = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.reserved_percentage = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.target_helper = tgtadm {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.target_ip_address = 192.168.122.159 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.target_port = 3260 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.target_protocol = iscsi {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.trace_flags = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.unique_fqdn_network = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.use_chap_auth = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.volume_backend_name = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.volume_clear = zero {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.volume_clear_ionice = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.volume_clear_size = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87842) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_reports.file_event_handler = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.quobyte [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_reports.log_dir = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.backend_availability_zone = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.backend_host = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.chap_password = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.chap_username = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.chiscsi_conf = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.quobyte [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.disk_geometry = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.driver_client_cert = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.driver_data_namespace = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Running cmd (subprocess): mount.quobyte {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.driver_use_ssl = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.extra_capabilities = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.filter_function = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.goodness_function = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.iser_helper = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.iser_ip_address = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.iser_port = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.iser_target_prefix = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.nas_host = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.nas_login = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.nas_mount_options = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.nas_password = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.nas_private_key = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack quobyte-client[87845]: Reading configuration file: /etc/quobyte/client.cfg Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.nas_share_path = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.nas_ssh_port = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.num_shell_tries = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack quobyte-client[87845]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.nvmet_port_id = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.replication_device = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.report_discard_supported = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.reserved_percentage = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.scst_target_driver = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.storage_protocol = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.target_helper = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.target_ip_address = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.target_port = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.target_prefix = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.target_protocol = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.trace_flags = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.use_chap_auth = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.volume_clear = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.volume_clear_size = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] QuobyteHD.volumes_dir = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:02 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.ssl = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_notifications.driver = [] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_notifications.retry = -1 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] key_manager.fixed_key = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican.barbican_api_version = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican.barbican_endpoint = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican.barbican_endpoint_type = public {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican.barbican_region_name = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican.cafile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican.certfile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican.collect_timing = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican.insecure = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican.keyfile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican.number_of_retries = 60 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican.retry_delay = 1 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican.send_service_user_token = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican.split_loggers = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican.timeout = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican.tls_ciphers = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican.tls_min_version = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican.verify_ssl = True {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican.verify_ssl_path = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican_service_user.auth_section = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican_service_user.auth_type = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican_service_user.cafile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican_service_user.certfile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican_service_user.collect_timing = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican_service_user.insecure = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican_service_user.keyfile = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican_service_user.split_loggers = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican_service_user.timeout = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican_service_user.tls_ciphers = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] barbican_service_user.tls_min_version = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] vault.approle_role_id = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] vault.approle_secret_id = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] vault.auth_method = approle {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] vault.auth_path = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] vault.kv_mountpoint = secret {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] vault.kv_path = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] vault.kv_version = 2 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] vault.namespace = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] vault.root_token_id = **** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] vault.ssl_ca_crt_file = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] vault.timeout = 60.0 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] vault.token_file = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] vault.token_role = None {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] vault.use_ssl = False {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 10 18:19:03 devstack cinder-volume[87543]: DEBUG oslo_service.backend._eventlet.service [None req-01f28f4c-7856-412a-9784-3eebe889de11 None None] ******************************************************************************** {{(pid=87543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] CMD "mount.quobyte" returned: 1 in 0.081s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:19:03 devstack sudo[87852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:19:03 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:19:03 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.242s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:19:03 devstack cinder-volume[87842]: INFO cinder.volume.driver [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Driver hasn't implemented _init_vendor_properties() Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG cinder.volume.driver [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2273559570312, 'free_capacity_gb': 1773.2273559570312, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87842) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG oslo_db.sqlalchemy.engines [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87842) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writer thread running {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG cinder.db.api [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Building query based on filter {{(pid=87842) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87842) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:19:03 devstack cinder-volume[87842]: INFO cinder.keymgr.migration [None req-f37e85e3-4fea-4362-a15c-07643dd02377 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 18:19:03 devstack sudo[87863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:19:03 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:19:03 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.239s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:19:03 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Driver initialization completed successfully. Sep 10 18:19:03 devstack cinder-volume[87842]: INFO cinder.manager [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Initiating service 3 cleanup Sep 10 18:19:03 devstack cinder-volume[87842]: INFO cinder.manager [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Service 3 cleanup completed. Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG cinder.service [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Creating RPC server for service cinder-volume {{(pid=87842) start /opt/stack/cinder/cinder/service.py:231}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG cinder.service [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87842) start /opt/stack/cinder/cinder/service.py:237}} Sep 10 18:19:03 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:19:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:19:03 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:19:03 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:19:04 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Sep 10 18:19:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.239s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:19:04 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-3c848296-412d-415c-b203-569d137b4ab3 None None] Driver post RPC initialization completed successfully. Sep 10 18:19:12 devstack cinder-volume[87543]: DEBUG dbcounter [-] [87543] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87543) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:19:13 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:19:14 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=1 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:19:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:19:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 6 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:19:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:20:12 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:20:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Flow 'volume_create_manager' (ee230098-254b-4f77-82c4-61f57ca8ef26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:20:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d120543a-5bd8-42ea-8851-f2b295755bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d120543a-5bd8-42ea-8851-f2b295755bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-8213152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222d35a2-8789-493b-8715-4bfb0ba0624c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5837072e82e4a4cbc57b17f5907d1d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:20:13Z,use_quota=True,user_id='5fb413ba650c4a9e825adbd64c4906e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46281d35-fade-48cd-b19c-25f671ee219d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46281d35-fade-48cd-b19c-25f671ee219d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f0b2eb-7a52-40a3-be80-987c67caf25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f0b2eb-7a52-40a3-be80-987c67caf25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '222d35a2-8789-493b-8715-4bfb0ba0624c', 'volume_name': 'volume-222d35a2-8789-493b-8715-4bfb0ba0624c', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313b92a5-0fbb-4b2b-bc23-51a92359d2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313b92a5-0fbb-4b2b-bc23-51a92359d2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505e0c0c-f44f-4ebf-a8c2-1ed8094367b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:13 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Volume 222d35a2-8789-493b-8715-4bfb0ba0624c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-222d35a2-8789-493b-8715-4bfb0ba0624c', 'volume_size': 1} Sep 10 18:20:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:20:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:20:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-8213152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222d35a2-8789-493b-8715-4bfb0ba0624c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5837072e82e4a4cbc57b17f5907d1d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:20:13Z,use_quota=True,user_id='5fb413ba650c4a9e825adbd64c4906e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:20:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Creating volume 222d35a2-8789-493b-8715-4bfb0ba0624c {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:20:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:20:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:20:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:20:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:20:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:20:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:20:13 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:20:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-222d35a2-8789-493b-8715-4bfb0ba0624c 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:13 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-222d35a2-8789-493b-8715-4bfb0ba0624c 1073741824 Sep 10 18:20:13 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:15 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-222d35a2-8789-493b-8715-4bfb0ba0624c 1073741824" returned: 0 in 2.102s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-222d35a2-8789-493b-8715-4bfb0ba0624c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:15 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-222d35a2-8789-493b-8715-4bfb0ba0624c Sep 10 18:20:15 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:16 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-222d35a2-8789-493b-8715-4bfb0ba0624c" returned: 0 in 0.855s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] <== create_volume: return (3207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:20:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.212s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:20:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505e0c0c-f44f-4ebf-a8c2-1ed8094367b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-222d35a2-8789-493b-8715-4bfb0ba0624c', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0783895-5470-41af-bab8-fc640d390c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:16 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Volume volume-222d35a2-8789-493b-8715-4bfb0ba0624c (222d35a2-8789-493b-8715-4bfb0ba0624c): created successfully Sep 10 18:20:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0783895-5470-41af-bab8-fc640d390c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Flow 'volume_create_manager' (ee230098-254b-4f77-82c4-61f57ca8ef26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:20:16 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-04ab352c-e5b0-4b6a-8b7b-5e064329eb84 tempest-DeleteServersTestJSON-1374832475 None] Created volume successfully. Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Flow 'volume_create_manager' (20bce8bc-34a3-4f08-afb9-ae471fbe80f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6e123a-1873-451d-b0e6-b7248da02af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6e123a-1873-451d-b0e6-b7248da02af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1666873478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c678fa-d0fd-4ce9-a264-5ac935a62fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1d9bfef8564c2a86e7b81a233ca139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:20:23Z,use_quota=True,user_id='5f2a3c36012e42c29b5789d823c0f809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441770c9-0d71-4030-b89a-cb8b3a5fd08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441770c9-0d71-4030-b89a-cb8b3a5fd08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf83037-a660-4e02-8940-ce18e2afd733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf83037-a660-4e02-8940-ce18e2afd733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2c678fa-d0fd-4ce9-a264-5ac935a62fdf', 'volume_name': 'volume-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728b751a-b355-4adf-933f-e86fe90e47d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728b751a-b355-4adf-933f-e86fe90e47d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e30c0a2-2d4a-4b9e-b8b8-0760467fbdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:23 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Volume b2c678fa-d0fd-4ce9-a264-5ac935a62fdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf', 'volume_size': 1} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1666873478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c678fa-d0fd-4ce9-a264-5ac935a62fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1d9bfef8564c2a86e7b81a233ca139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:20:23Z,use_quota=True,user_id='5f2a3c36012e42c29b5789d823c0f809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Creating volume b2c678fa-d0fd-4ce9-a264-5ac935a62fdf {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:20:23 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:23 devstack sudo[89021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf 1073741824 Sep 10 18:20:23 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:23 devstack cinder-volume[87842]: WARNING py.warnings [req-b01015e4-c76c-4a4e-a0bb-4711811eb41b req-0952a850-edac-43fb-befb-cfaeecf932ef tempest-DeleteServersTestJSON-1374832475 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 10 18:20:23 devstack cinder-volume[87842]: .first() Sep 10 18:20:23 devstack cinder-volume[87842]: Sep 10 18:20:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-b01015e4-c76c-4a4e-a0bb-4711811eb41b req-0952a850-edac-43fb-befb-cfaeecf932ef tempest-DeleteServersTestJSON-1374832475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:20:24 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf 1073741824" returned: 0 in 0.896s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:24 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf Sep 10 18:20:24 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:24 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf" returned: 0 in 0.343s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:24 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:20:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:20:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-b01015e4-c76c-4a4e-a0bb-4711811eb41b req-0952a850-edac-43fb-befb-cfaeecf932ef tempest-DeleteServersTestJSON-1374832475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.820s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:20:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e30c0a2-2d4a-4b9e-b8b8-0760467fbdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e496a5b-e02d-4d93-ab12-2d0c3c6e49b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:24 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Volume volume-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf (b2c678fa-d0fd-4ce9-a264-5ac935a62fdf): created successfully Sep 10 18:20:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e496a5b-e02d-4d93-ab12-2d0c3c6e49b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Flow 'volume_create_manager' (20bce8bc-34a3-4f08-afb9-ae471fbe80f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:20:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-b01015e4-c76c-4a4e-a0bb-4711811eb41b req-0952a850-edac-43fb-befb-cfaeecf932ef tempest-DeleteServersTestJSON-1374832475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.159s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:20:24 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e9c8de97-6e27-4d6a-99d3-b7e703ac8964 tempest-VolumesAdminNegativeTest-1658740162 None] Created volume successfully. Sep 10 18:20:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-b01015e4-c76c-4a4e-a0bb-4711811eb41b req-0952a850-edac-43fb-befb-cfaeecf932ef tempest-DeleteServersTestJSON-1374832475 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-222d35a2-8789-493b-8715-4bfb0ba0624c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37a69ae6-272e-444f-bc52-0a5a93e11785', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:20:24 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-b01015e4-c76c-4a4e-a0bb-4711811eb41b req-0952a850-edac-43fb-befb-cfaeecf932ef tempest-DeleteServersTestJSON-1374832475 None] attachment_update completed successfully. Sep 10 18:20:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Acquiring lock "cinder-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:20:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Lock "cinder-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:20:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Acquiring lock "cinder-quobyte-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:20:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Lock "cinder-quobyte-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf" acquired by "delete_volume" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:20:25 devstack cinder-volume[87842]: INFO oslo.privsep.daemon [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpoc_m_5pk/privsep.sock'] Sep 10 18:20:25 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpoc_m_5pk/privsep.sock Sep 10 18:20:25 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:27 devstack cinder-volume[87842]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 10 18:20:27 devstack cinder-volume[87842]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 10 18:20:27 devstack cinder-volume[87842]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 10 18:20:27 devstack cinder-volume[87842]: WARNING oslo.privsep.daemon [-] privsep log: Sep 10 18:20:27 devstack cinder-volume[87842]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 10 18:20:27 devstack cinder-volume[87842]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 10 18:20:27 devstack cinder-volume[87842]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 10 18:20:27 devstack cinder-volume[87842]: WARNING oslo.privsep.daemon [-] privsep log: Sep 10 18:20:27 devstack cinder-volume[87842]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 10 18:20:27 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:27 devstack cinder-volume[87842]: INFO oslo.privsep.daemon [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Spawned new privsep daemon via rootwrap Sep 10 18:20:27 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Accepted privsep connection to /tmp/tmpoc_m_5pk/privsep.sock {{(pid=87842) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 10 18:20:27 devstack cinder-volume[87842]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 10 18:20:27 devstack cinder-volume[87842]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 10 18:20:27 devstack cinder-volume[87842]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 10 18:20:27 devstack cinder-volume[87842]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89425 Sep 10 18:20:27 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b85cd4e-d462-4334-af5c-752a9199dcab]: (2,) {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:20:27 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d297fb-14ed-4c27-af13-d61c64ce0c43]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:20:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:27 devstack sudo[89427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf Sep 10 18:20:27 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:28 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf" returned: 0 in 0.585s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:28 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf Sep 10 18:20:28 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:28 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf" returned: 0 in 0.716s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:20:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:20:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:20:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:20:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:20:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:20:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Lock "cinder-quobyte-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf" released by "delete_volume" :: held 3.229s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:20:29 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:20:29 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:29 devstack cinder-volume[87842]: WARNING cinder.quota [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:20:29 devstack cinder-volume[87842]: WARNING cinder.quota [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:20:29 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Created reservations ['ecc351dc-cc2c-48b2-ade3-e592d654560b', '63005045-7e3c-4c06-8836-993a3c9c521d', '589d5835-6497-44a8-94cb-1040d2286842', '372b93bf-3942-49f6-a2a1-f3155b0d83ff'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:20:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:20:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:20:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:20:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:20:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:20:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:29 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:20:29 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:30 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 1.034s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:30 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:20:30 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:20:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 8 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:20:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:20:30 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.645s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:30 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:20:30 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Deleted volume successfully. Sep 10 18:20:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-eafc1bb2-d3e5-4ff9-8b0f-93ef4e5de129 tempest-VolumesAdminNegativeTest-1658740162 None] Lock "cinder-b2c678fa-d0fd-4ce9-a264-5ac935a62fdf-delete_volume" released by "delete_volume" :: held 4.496s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:20:31 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-79856f03-9456-4ed7-bde7-68c097daa313 req-ace14a5c-2e0f-49e7-9a0a-6cc44dd86223 tempest-DeleteServersTestJSON-1374832475 None] Terminate volume connection completed successfully. Sep 10 18:20:31 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-79856f03-9456-4ed7-bde7-68c097daa313 req-ace14a5c-2e0f-49e7-9a0a-6cc44dd86223 tempest-DeleteServersTestJSON-1374832475 None] Deleting attachment 37a69ae6-272e-444f-bc52-0a5a93e11785. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:20:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] Acquiring lock "cinder-222d35a2-8789-493b-8715-4bfb0ba0624c-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:20:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] Lock "cinder-222d35a2-8789-493b-8715-4bfb0ba0624c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:20:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] Acquiring lock "cinder-quobyte-222d35a2-8789-493b-8715-4bfb0ba0624c" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:20:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] Lock "cinder-quobyte-222d35a2-8789-493b-8715-4bfb0ba0624c" acquired by "delete_volume" :: waited 0.017s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:20:33 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ed8112-c498-43fe-9b70-ac0f3fd76c50]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:20:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-222d35a2-8789-493b-8715-4bfb0ba0624c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:33 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-222d35a2-8789-493b-8715-4bfb0ba0624c Sep 10 18:20:33 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:33 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-222d35a2-8789-493b-8715-4bfb0ba0624c" returned: 0 in 0.387s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-222d35a2-8789-493b-8715-4bfb0ba0624c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:33 devstack sudo[89551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-222d35a2-8789-493b-8715-4bfb0ba0624c Sep 10 18:20:33 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:33 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-222d35a2-8789-493b-8715-4bfb0ba0624c" returned: 0 in 0.250s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] Lock "cinder-quobyte-222d35a2-8789-493b-8715-4bfb0ba0624c" released by "delete_volume" :: held 0.684s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:20:33 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] Created reservations ['6cab1e7f-6363-4ee7-86d3-856c24690552', '34fc3bad-953b-4996-9188-11102d3377ff', '4c6889c7-5e41-4139-a796-f147fbfd7c1b', 'e3f16c16-1694-4907-a9fb-966fb6d04511'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:20:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:20:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:20:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:20:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:20:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:20:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:33 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:20:33 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:34 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.291s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:34 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:20:34 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] Deleted volume successfully. Sep 10 18:20:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bcf577e7-a5ac-4d29-aad9-39f4df146e4f tempest-DeleteServersTestJSON-1374832475 None] Lock "cinder-222d35a2-8789-493b-8715-4bfb0ba0624c-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Flow 'volume_create_manager' (96aaa4be-951e-4ac2-8100-2b40d53254f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9c51e5-bae3-4fd2-a4aa-39a261fcd6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9c51e5-bae3-4fd2-a4aa-39a261fcd6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-161298856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fb9050ce77463595102dbb2bc90b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:20:44Z,use_quota=True,user_id='37b588b06fee46f2b24f8526f74a0667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe6aa46-cd6f-4229-9d27-843247ad4339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe6aa46-cd6f-4229-9d27-843247ad4339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69eae7a-a372-4023-8b2c-be50965b7407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69eae7a-a372-4023-8b2c-be50965b7407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5', 'volume_name': 'volume-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae468534-30b3-4bbd-9869-5c2add4137fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae468534-30b3-4bbd-9869-5c2add4137fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc56a754-616d-4a3c-bd8e-0374ee4b9ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:43 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Volume 55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5', 'volume_size': 1} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-161298856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fb9050ce77463595102dbb2bc90b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:20:44Z,use_quota=True,user_id='37b588b06fee46f2b24f8526f74a0667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Creating volume 55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:20:43 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:20:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:43 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5 1073741824 Sep 10 18:20:43 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:44 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5 1073741824" returned: 0 in 0.673s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:44 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5 Sep 10 18:20:44 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:44 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5" returned: 0 in 0.281s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:20:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:20:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc56a754-616d-4a3c-bd8e-0374ee4b9ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f963e153-af42-43b4-a850-edcc8d976957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:44 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Volume volume-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5 (55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5): created successfully Sep 10 18:20:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f963e153-af42-43b4-a850-edcc8d976957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Flow 'volume_create_manager' (96aaa4be-951e-4ac2-8100-2b40d53254f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:20:44 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d94ea394-ce0b-4b44-a282-0d22c85ae67e tempest-ServerActionsTestOtherA-1901608082 None] Created volume successfully. Sep 10 18:20:48 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ad6050c7-4fe6-4079-b9cb-3830d6576138 tempest-GroupSnapshotsTest-1073590332 None] Group tempest-GroupSnapshotsTest-Group-162899015: creating Sep 10 18:20:48 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ad6050c7-4fe6-4079-b9cb-3830d6576138 tempest-GroupSnapshotsTest-1073590332 None] Group tempest-GroupSnapshotsTest-Group-162899015: created successfully Sep 10 18:20:48 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ad6050c7-4fe6-4079-b9cb-3830d6576138 tempest-GroupSnapshotsTest-1073590332 None] Create group completed successfully. Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Flow 'volume_create_manager' (400ce39e-d65c-4022-90a2-a07f26dd2122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33198131-e789-4181-8b81-2cd6b42c299c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33198131-e789-4181-8b81-2cd6b42c299c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1178261457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8bdf0113-d553-4d32-98d4-5d412ab54123,host='devstack@QuobyteHD#QuobyteHD',id=1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b771bdd30f542b28ae74d7a159acf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:20:51Z,use_quota=True,user_id='00263234d1b54c7eb03633735aa5e82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7599d04-b860-4853-818d-0d2b6e27fc63),volume_type_id=b7599d04-b860-4853-818d-0d2b6e27fc63)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800c5d41-59cd-486f-8569-1d10944efa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800c5d41-59cd-486f-8569-1d10944efa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff1a8f1-8a2c-4151-9958-609ad545f2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff1a8f1-8a2c-4151-9958-609ad545f2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0', 'volume_name': 'volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617d7e19-9877-49f4-a027-720a138e0015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617d7e19-9877-49f4-a027-720a138e0015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce06ec0d-6f64-44f6-83a8-853c0df59e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:50 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Volume 1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0', 'volume_size': 1} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8bdf0113-d553-4d32-98d4-5d412ab54123,created_at=2026-09-10T16:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1178261457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8bdf0113-d553-4d32-98d4-5d412ab54123,host='devstack@QuobyteHD#QuobyteHD',id=1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b771bdd30f542b28ae74d7a159acf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:20:51Z,use_quota=True,user_id='00263234d1b54c7eb03633735aa5e82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7599d04-b860-4853-818d-0d2b6e27fc63),volume_type_id=b7599d04-b860-4853-818d-0d2b6e27fc63)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Creating volume 1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:20:50 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:20:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:50 devstack sudo[89600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 1073741824 Sep 10 18:20:50 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:51 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 1073741824" returned: 0 in 0.751s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:51 devstack sudo[89608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 Sep 10 18:20:51 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:52 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0" returned: 0 in 0.369s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:20:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:20:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce06ec0d-6f64-44f6-83a8-853c0df59e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315d49e9-1bb7-4e09-a785-ecede11f9194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:20:52 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Volume volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 (1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0): created successfully Sep 10 18:20:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315d49e9-1bb7-4e09-a785-ecede11f9194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:20:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Flow 'volume_create_manager' (400ce39e-d65c-4022-90a2-a07f26dd2122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:20:52 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-b49a514d-eb18-4186-8e66-41e8c45c1143 tempest-GroupSnapshotsTest-1073590332 None] Created volume successfully. Sep 10 18:20:53 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] GroupSnapshot 27f5990c-a406-4472-9df3-888ed1c70d54: creating. Sep 10 18:20:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] Group snapshot 27f5990c-a406-4472-9df3-888ed1c70d54: creating. {{(pid=87842) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 10 18:20:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:20:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:20:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] Creating offline snapshot 72d2d3b3-b386-41d1-9342-47c5330a113a of volume 1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:20:53 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5578fb2a-8f71-4a46-b6d9-571caf3e4500]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:20:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:53 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 Sep 10 18:20:53 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:54 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0" returned: 0 in 0.402s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:54 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a 1G Sep 10 18:20:54 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:54 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a 1G" returned: 0 in 0.538s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:54 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a Sep 10 18:20:54 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:55 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a" returned: 0 in 0.346s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:55 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a is being set with open permissions: ugo+rw: NotImplementedError Sep 10 18:20:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:55 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a Sep 10 18:20:55 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:55 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a" returned: 0 in 0.295s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:55 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.info Sep 10 18:20:55 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:55 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.info" returned: 0 in 0.321s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:55 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 18:20:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:55 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.info Sep 10 18:20:55 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:56 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.info" returned: 0 in 0.620s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.633s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:20:56 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-5ab071b4-ccd3-47dd-a747-e6162dc35a2f tempest-GroupSnapshotsTest-1073590332 None] group_snapshot 27f5990c-a406-4472-9df3-888ed1c70d54: created successfully Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "cinder-quobyte-72d2d3b3-b386-41d1-9342-47c5330a113a-0ed98eb8-1a05-4005-81d3-f2fbec15181d" by "_create_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-72d2d3b3-b386-41d1-9342-47c5330a113a-0ed98eb8-1a05-4005-81d3-f2fbec15181d" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Creating volume 0ed98eb8-1a05-4005-81d3-f2fbec15181d from snapshot 72d2d3b3-b386-41d1-9342-47c5330a113a {{(pid=87842) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "cinder-quobyte-0ed98eb8-1a05-4005-81d3-f2fbec15181d" by "_copy_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-0ed98eb8-1a05-4005-81d3-f2fbec15181d" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] snapshot: 72d2d3b3-b386-41d1-9342-47c5330a113a, volume: 0ed98eb8-1a05-4005-81d3-f2fbec15181d, {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9a8422-a04c-4409-aab6-09a5a82eb588]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:20:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:58 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a Sep 10 18:20:58 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:20:59 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Sep 10 18:20:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a" returned: 0 in 0.683s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:20:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:20:59 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4260ba15-3e31-437f-90b2-f3d57824d9e5]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:20:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:20:59 devstack sudo[89708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 Sep 10 18:20:59 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:00 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0" returned: 0 in 0.787s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:00 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 18:21:00 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Creating direct copy from snapshot {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 18:21:00 devstack cinder-volume[87842]: DEBUG cinder.utils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Path /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ed98eb8-1a05-4005-81d3-f2fbec15181d not found in is_blk_device check {{(pid=87842) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 18:21:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ed98eb8-1a05-4005-81d3-f2fbec15181d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:00 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ed98eb8-1a05-4005-81d3-f2fbec15181d Sep 10 18:21:00 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:04 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=41,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:21:04 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=31,cinder:UPDATE=34,cinder:INSERT=7,cinder:DELETE=4 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:21:08 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ed98eb8-1a05-4005-81d3-f2fbec15181d" returned: 0 in 8.343s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:08 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Image conversion details: src /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0, size 1024.00 MB, duration 8.34 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ed98eb8-1a05-4005-81d3-f2fbec15181d {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:21:08 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Converted 1024.00 MB image at 122.72 MB/s Sep 10 18:21:08 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ed98eb8-1a05-4005-81d3-f2fbec15181d is being set with open permissions: ugo+rw: NotImplementedError Sep 10 18:21:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ed98eb8-1a05-4005-81d3-f2fbec15181d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:08 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ed98eb8-1a05-4005-81d3-f2fbec15181d Sep 10 18:21:08 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:08 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ed98eb8-1a05-4005-81d3-f2fbec15181d" returned: 0 in 0.334s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-0ed98eb8-1a05-4005-81d3-f2fbec15181d" released by "_copy_volume_from_snapshot" :: held 10.275s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:21:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-72d2d3b3-b386-41d1-9342-47c5330a113a-0ed98eb8-1a05-4005-81d3-f2fbec15181d" released by "_create_volume_from_snapshot" :: held 10.365s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:21:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.411s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:08 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-b9d15bf0-90c1-4290-81d8-b2b3a81f7638 tempest-GroupSnapshotsTest-1073590332 None] Create group from source-snapshot-27f5990c-a406-4472-9df3-888ed1c70d54 completed successfully. Sep 10 18:21:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "cinder-quobyte-0ed98eb8-1a05-4005-81d3-f2fbec15181d" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:21:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-0ed98eb8-1a05-4005-81d3-f2fbec15181d" acquired by "delete_volume" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:21:10 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0557bc0d-99ac-43ae-824b-24b089848768]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:21:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ed98eb8-1a05-4005-81d3-f2fbec15181d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:10 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ed98eb8-1a05-4005-81d3-f2fbec15181d Sep 10 18:21:10 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:10 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ed98eb8-1a05-4005-81d3-f2fbec15181d" returned: 0 in 0.570s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ed98eb8-1a05-4005-81d3-f2fbec15181d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:10 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ed98eb8-1a05-4005-81d3-f2fbec15181d Sep 10 18:21:10 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:10 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ed98eb8-1a05-4005-81d3-f2fbec15181d" returned: 0 in 0.324s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:11 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-0ed98eb8-1a05-4005-81d3-f2fbec15181d" released by "delete_volume" :: held 0.970s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:21:11 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] Created reservations ['008e9192-187d-4279-852a-7a1bfde757cb'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:21:11 devstack cinder-volume[87842]: WARNING cinder.quota [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1687765909 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1687765909, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:21:11 devstack cinder-volume[87842]: WARNING cinder.quota [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1687765909 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1687765909, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:21:11 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] Created reservations ['473b650e-5efa-4142-8432-f9ccc8ff5b41', '2e78a135-98be-4de0-8e54-cb64d2130a48', 'bdea848f-ad8c-4f60-9789-0b097fedb393', 'fa4ed9fb-b342-4878-93de-45769128890d'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:21:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:21:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:21:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:11 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:21:11 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:11 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.322s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:11 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:21:11 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-335c427a-c54e-47a6-806a-1e8ae30ef930 tempest-GroupSnapshotsTest-1073590332 None] Delete group completed successfully. Sep 10 18:21:12 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] group_snapshot 27f5990c-a406-4472-9df3-888ed1c70d54: deleting Sep 10 18:21:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] group_snapshot 27f5990c-a406-4472-9df3-888ed1c70d54: deleting {{(pid=87842) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 10 18:21:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "cinder-quobyte-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:21:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:21:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "cinder-quobyte-72d2d3b3-b386-41d1-9342-47c5330a113a" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:21:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-72d2d3b3-b386-41d1-9342-47c5330a113a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:21:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] Deleting offline snapshot 72d2d3b3-b386-41d1-9342-47c5330a113a of volume 1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:21:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] snapshot_file for this snap is: volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:21:12 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec81a45-98d9-4e6d-95a6-e958209c693a]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:21:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:12 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a Sep 10 18:21:12 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:13 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a" returned: 0 in 0.409s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:21:13 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c7bed6-1813-483b-9f6a-7b30c8bdd484]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:21:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:13 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 Sep 10 18:21:13 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:13 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0" returned: 0 in 0.556s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:13 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a Sep 10 18:21:13 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:14 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a" returned: 0 in 0.419s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:14 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a Sep 10 18:21:14 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:14 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0.72d2d3b3-b386-41d1-9342-47c5330a113a" returned: 0 in 0.263s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:14 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-72d2d3b3-b386-41d1-9342-47c5330a113a" released by "_delete_snapshot" :: held 1.788s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:21:14 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0" released by "delete_snapshot" :: held 1.822s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:21:14 devstack cinder-volume[87842]: WARNING cinder.quota [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1687765909 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1687765909, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:21:14 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] Created reservations ['9af39846-f449-4e05-8c0f-cf843cba49e3', '84c53ef6-d684-4555-ab67-9c22193bf50c', '5a42ba3b-d833-4471-aa55-e33187ec0c3f', '4fa872ea-f649-403d-974e-bbb0f4704ffb'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:21:14 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e6b51ee7-37ba-4f2b-ad95-b802f3962209 tempest-GroupSnapshotsTest-1073590332 None] group_snapshot 27f5990c-a406-4472-9df3-888ed1c70d54: deleted successfully Sep 10 18:21:15 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8c26ee59-2112-4891-8375-ff4022ada650 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "cinder-quobyte-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:21:15 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8c26ee59-2112-4891-8375-ff4022ada650 tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0" acquired by "delete_volume" :: waited 0.044s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:21:15 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb45cffd-f0b9-4a6f-b253-3021fd585b61]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:21:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8c26ee59-2112-4891-8375-ff4022ada650 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:15 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 Sep 10 18:21:15 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:15 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8c26ee59-2112-4891-8375-ff4022ada650 tempest-GroupSnapshotsTest-1073590332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0" returned: 0 in 0.469s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8c26ee59-2112-4891-8375-ff4022ada650 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:15 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0 Sep 10 18:21:15 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:16 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8c26ee59-2112-4891-8375-ff4022ada650 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0" returned: 0 in 0.280s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8c26ee59-2112-4891-8375-ff4022ada650 tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-1d8433ce-e55f-4ad1-b73c-36d3bec1bcb0" released by "delete_volume" :: held 0.863s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:21:16 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-8c26ee59-2112-4891-8375-ff4022ada650 tempest-GroupSnapshotsTest-1073590332 None] Created reservations ['289dfed2-0b17-49b9-bf8d-ffc5b0c3865a'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:21:16 devstack cinder-volume[87842]: WARNING cinder.db.api [None req-8c26ee59-2112-4891-8375-ff4022ada650 tempest-GroupSnapshotsTest-1073590332 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1687765909'] Sep 10 18:21:16 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-8c26ee59-2112-4891-8375-ff4022ada650 tempest-GroupSnapshotsTest-1073590332 None] Created reservations ['bd6d56ac-8c74-4858-91d6-a484ffb0e7dd', '5db55844-5667-4b38-8fad-93fd696fa510', '790b89b8-5a7f-4995-864b-7b84ad4316c9', '5b47323a-0eea-44d6-b975-21fcb87b5871'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:21:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8c26ee59-2112-4891-8375-ff4022ada650 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8c26ee59-2112-4891-8375-ff4022ada650 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8c26ee59-2112-4891-8375-ff4022ada650 tempest-GroupSnapshotsTest-1073590332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:21:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8c26ee59-2112-4891-8375-ff4022ada650 tempest-GroupSnapshotsTest-1073590332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:21:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8c26ee59-2112-4891-8375-ff4022ada650 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8c26ee59-2112-4891-8375-ff4022ada650 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:16 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:21:16 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:16 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8c26ee59-2112-4891-8375-ff4022ada650 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.537s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:16 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-8c26ee59-2112-4891-8375-ff4022ada650 tempest-GroupSnapshotsTest-1073590332 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:21:16 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-8c26ee59-2112-4891-8375-ff4022ada650 tempest-GroupSnapshotsTest-1073590332 None] Delete group completed successfully. Sep 10 18:21:17 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-76ca0e8d-8990-429f-b274-85beb523eb38 tempest-GroupSnapshotsTest-1073590332 None] Group tempest-GroupSnapshotsTest-Group-47603274: creating Sep 10 18:21:17 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-76ca0e8d-8990-429f-b274-85beb523eb38 tempest-GroupSnapshotsTest-1073590332 None] Group tempest-GroupSnapshotsTest-Group-47603274: created successfully Sep 10 18:21:17 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-76ca0e8d-8990-429f-b274-85beb523eb38 tempest-GroupSnapshotsTest-1073590332 None] Create group completed successfully. Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Flow 'volume_create_manager' (6dee5932-bb26-4e34-8c93-217354b313cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (435aeb60-c2ff-41be-a390-457cbaffb24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (435aeb60-c2ff-41be-a390-457cbaffb24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-992377035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=824e8fe3-8a82-4410-87c5-d5d7dcadda78,host='devstack@QuobyteHD#QuobyteHD',id=86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b771bdd30f542b28ae74d7a159acf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:21:19Z,use_quota=True,user_id='00263234d1b54c7eb03633735aa5e82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fe50a2-6e5e-4d82-9b5d-7c771358640b),volume_type_id=b0fe50a2-6e5e-4d82-9b5d-7c771358640b)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fcbd30-7f79-4b45-b0d7-bee7ab9a0a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fcbd30-7f79-4b45-b0d7-bee7ab9a0a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcbebbc0-98f3-4396-9994-ba774c52d002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcbebbc0-98f3-4396-9994-ba774c52d002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8', 'volume_name': 'volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c521bd46-afd4-41b4-8d6a-a80fab3c0358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c521bd46-afd4-41b4-8d6a-a80fab3c0358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5343bb02-75b0-4d2b-b507-578943e5c752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:18 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Volume 86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8', 'volume_size': 1} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=824e8fe3-8a82-4410-87c5-d5d7dcadda78,created_at=2026-09-10T16:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-992377035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=824e8fe3-8a82-4410-87c5-d5d7dcadda78,host='devstack@QuobyteHD#QuobyteHD',id=86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b771bdd30f542b28ae74d7a159acf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:21:19Z,use_quota=True,user_id='00263234d1b54c7eb03633735aa5e82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fe50a2-6e5e-4d82-9b5d-7c771358640b),volume_type_id=b0fe50a2-6e5e-4d82-9b5d-7c771358640b)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Creating volume 86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:21:18 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:21:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:19 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 1073741824 Sep 10 18:21:19 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:19 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 1073741824" returned: 0 in 0.577s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:19 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 Sep 10 18:21:19 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:19 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8" returned: 0 in 0.261s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:21:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5343bb02-75b0-4d2b-b507-578943e5c752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf3edbf-e7b9-4f5d-a991-a7ad0ddd58a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:19 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Volume volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 (86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8): created successfully Sep 10 18:21:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf3edbf-e7b9-4f5d-a991-a7ad0ddd58a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Flow 'volume_create_manager' (6dee5932-bb26-4e34-8c93-217354b313cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:21:19 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-a30e7e15-1b25-487c-a8aa-a0c8887a2897 tempest-GroupSnapshotsTest-1073590332 None] Created volume successfully. Sep 10 18:21:20 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:21:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Flow 'volume_create_manager' (b6368a5e-ea90-42cd-96a0-413b3a5eda94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:21:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7969c8c-8baf-4e48-abcc-0c84a5d0fe15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7969c8c-8baf-4e48-abcc-0c84a5d0fe15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1481136316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=824e8fe3-8a82-4410-87c5-d5d7dcadda78,host='devstack@QuobyteHD#QuobyteHD',id=565db710-4a9c-49e1-acd1-79367585caa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b771bdd30f542b28ae74d7a159acf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:21:21Z,use_quota=True,user_id='00263234d1b54c7eb03633735aa5e82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fe50a2-6e5e-4d82-9b5d-7c771358640b),volume_type_id=b0fe50a2-6e5e-4d82-9b5d-7c771358640b)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbeb7f4-5ae8-49a0-ada0-a6c871edbdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbeb7f4-5ae8-49a0-ada0-a6c871edbdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9e5f82-e2b2-4de7-b233-9bc580940c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9e5f82-e2b2-4de7-b233-9bc580940c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '565db710-4a9c-49e1-acd1-79367585caa9', 'volume_name': 'volume-565db710-4a9c-49e1-acd1-79367585caa9', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a50035-1702-405b-8144-44fb4051d555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a50035-1702-405b-8144-44fb4051d555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67a713a-7fe1-4a14-b09a-b933ef3310e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:20 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Volume 565db710-4a9c-49e1-acd1-79367585caa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-565db710-4a9c-49e1-acd1-79367585caa9', 'volume_size': 1} Sep 10 18:21:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=824e8fe3-8a82-4410-87c5-d5d7dcadda78,created_at=2026-09-10T16:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1481136316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=824e8fe3-8a82-4410-87c5-d5d7dcadda78,host='devstack@QuobyteHD#QuobyteHD',id=565db710-4a9c-49e1-acd1-79367585caa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b771bdd30f542b28ae74d7a159acf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:21:21Z,use_quota=True,user_id='00263234d1b54c7eb03633735aa5e82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fe50a2-6e5e-4d82-9b5d-7c771358640b),volume_type_id=b0fe50a2-6e5e-4d82-9b5d-7c771358640b)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:21:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Creating volume 565db710-4a9c-49e1-acd1-79367585caa9 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:21:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:21:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:21:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:21:21 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:21:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:21 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9 1073741824 Sep 10 18:21:21 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:21 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9 1073741824" returned: 0 in 0.586s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:21 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9 Sep 10 18:21:21 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:21 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9" returned: 0 in 0.291s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:21:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67a713a-7fe1-4a14-b09a-b933ef3310e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-565db710-4a9c-49e1-acd1-79367585caa9', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a101e6-a38b-4ed0-af4f-857c104e1a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:21 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Volume volume-565db710-4a9c-49e1-acd1-79367585caa9 (565db710-4a9c-49e1-acd1-79367585caa9): created successfully Sep 10 18:21:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a101e6-a38b-4ed0-af4f-857c104e1a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Flow 'volume_create_manager' (b6368a5e-ea90-42cd-96a0-413b3a5eda94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:21:22 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-2f9b21bd-ff2c-4eff-985c-b14898dc5e00 tempest-GroupSnapshotsTest-1073590332 None] Created volume successfully. Sep 10 18:21:22 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-9e7ceb10-9bf7-4bfb-9c0e-1657c0c37663 tempest-GroupSnapshotsTest-1073590332 None] Update group completed successfully. Sep 10 18:21:23 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-2f9450cd-ec18-4623-a843-1e5154be1702 tempest-GroupSnapshotsTest-1073590332 None] Update group completed successfully. Sep 10 18:21:25 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f5feef02-6e53-484b-8efd-c4d5af3ff497 tempest-GroupSnapshotsTest-1073590332 None] Update group completed successfully. Sep 10 18:21:26 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-b9ebff9c-4ba5-4ef8-b61f-517c75e28d39 tempest-GroupSnapshotsTest-1073590332 None] Update group completed successfully. Sep 10 18:21:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-4c23214b-cb26-4750-993e-c5920196b1c3 req-2575e1af-af44-4f6b-8607-3974425bfefb tempest-ServerActionsTestOtherA-1901608082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-4c23214b-cb26-4750-993e-c5920196b1c3 req-2575e1af-af44-4f6b-8607-3974425bfefb tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-4c23214b-cb26-4750-993e-c5920196b1c3 req-2575e1af-af44-4f6b-8607-3974425bfefb tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-4c23214b-cb26-4750-993e-c5920196b1c3 req-2575e1af-af44-4f6b-8607-3974425bfefb tempest-ServerActionsTestOtherA-1901608082 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6cc57caa-d900-498c-bcae-5710a81ec41f', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:21:26 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-4c23214b-cb26-4750-993e-c5920196b1c3 req-2575e1af-af44-4f6b-8607-3974425bfefb tempest-ServerActionsTestOtherA-1901608082 None] attachment_update completed successfully. Sep 10 18:21:27 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] GroupSnapshot ee1cb2b9-8293-4933-8a38-a10f89c978ce: creating. Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Group snapshot ee1cb2b9-8293-4933-8a38-a10f89c978ce: creating. {{(pid=87842) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Creating offline snapshot 01f02fd5-a686-473a-b5d6-ff76cd0f14cd of volume 565db710-4a9c-49e1-acd1-79367585caa9 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04d7c6f-29d9-49c3-b3ee-387354319270]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:28 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9 Sep 10 18:21:28 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:28 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9" returned: 0 in 0.503s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:28 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd 1G Sep 10 18:21:28 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Flow 'volume_create_manager' (47584402-b139-47a5-b20d-0151455b42c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14376b52-0e82-402b-8722-08420771ab1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14376b52-0e82-402b-8722-08420771ab1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-65196292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e96008-8c90-40b8-a615-e5bee8a732f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36754886681444a5bf12b11ea3f7448a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:21:29Z,use_quota=True,user_id='866128e472954872bc8993a67551d57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c97cfcd-6369-47fd-805d-3a2186cd215f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c97cfcd-6369-47fd-805d-3a2186cd215f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31857baa-423c-43c7-99c7-adc8d2bc847e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31857baa-423c-43c7-99c7-adc8d2bc847e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16e96008-8c90-40b8-a615-e5bee8a732f5', 'volume_name': 'volume-16e96008-8c90-40b8-a615-e5bee8a732f5', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73f2a8f-bb3a-467d-a7a2-03671b878408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73f2a8f-bb3a-467d-a7a2-03671b878408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e004b642-353b-4ea3-99ff-9aa48cd21c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:28 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Volume 16e96008-8c90-40b8-a615-e5bee8a732f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16e96008-8c90-40b8-a615-e5bee8a732f5', 'volume_size': 1} Sep 10 18:21:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:21:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:21:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:21:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:29 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:21:29 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:29 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd 1G" returned: 0 in 0.575s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565db710-4a9c-49e1-acd1-79367585caa9 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:29 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565db710-4a9c-49e1-acd1-79367585caa9 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd Sep 10 18:21:29 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:29 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.310s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:21:29 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565db710-4a9c-49e1-acd1-79367585caa9 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd" returned: 0 in 0.506s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:29 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd is being set with open permissions: ugo+rw: NotImplementedError Sep 10 18:21:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:29 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd Sep 10 18:21:29 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:30 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd" returned: 0 in 0.354s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:30 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.info Sep 10 18:21:30 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:30 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.info" returned: 0 in 0.383s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:30 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 18:21:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:30 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.info Sep 10 18:21:30 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:30 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-cc58537a-d973-4fad-a347-4800fa508003 req-57c3811d-c2dc-4d07-a328-d7152a864ce4 tempest-ServerActionsTestOtherA-1901608082 None] Terminate volume connection completed successfully. Sep 10 18:21:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-cc58537a-d973-4fad-a347-4800fa508003 req-57c3811d-c2dc-4d07-a328-d7152a864ce4 tempest-ServerActionsTestOtherA-1901608082 None] Deleting attachment 6cc57caa-d900-498c-bcae-5710a81ec41f. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:21:30 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.info" returned: 0 in 0.298s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.758s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Creating offline snapshot 2ba9cdd7-a280-45ab-9040-78ed977906f9 of volume 86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:21:30 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02bce11-ff95-486b-9239-20d3653e35f9]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:21:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:30 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 Sep 10 18:21:30 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:31 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8" returned: 0 in 0.607s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:31 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9 1G Sep 10 18:21:31 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-cc58537a-d973-4fad-a347-4800fa508003 req-0b052d04-971c-4c26-a5e7-9b4554b78a9f tempest-ServerActionsTestOtherA-1901608082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:31 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9 1G" returned: 0 in 0.519s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:31 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9 Sep 10 18:21:31 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:32 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9" returned: 0 in 0.318s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:32 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 18:21:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:32 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9 Sep 10 18:21:32 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:32 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9" returned: 0 in 0.254s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:32 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.info Sep 10 18:21:32 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:32 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.info" returned: 0 in 0.278s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:32 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 18:21:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:32 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.info Sep 10 18:21:32 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:33 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.info" returned: 0 in 0.330s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.408s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.373s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-65196292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e96008-8c90-40b8-a615-e5bee8a732f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36754886681444a5bf12b11ea3f7448a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:21:29Z,use_quota=True,user_id='866128e472954872bc8993a67551d57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:21:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Creating volume 16e96008-8c90-40b8-a615-e5bee8a732f5 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:21:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:21:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:21:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:21:33 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:21:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16e96008-8c90-40b8-a615-e5bee8a732f5 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:33 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16e96008-8c90-40b8-a615-e5bee8a732f5 1073741824 Sep 10 18:21:33 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:33 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-72004bc9-3be6-47ff-a13a-e7b945134a75 tempest-GroupSnapshotsTest-1073590332 None] group_snapshot ee1cb2b9-8293-4933-8a38-a10f89c978ce: created successfully Sep 10 18:21:34 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16e96008-8c90-40b8-a615-e5bee8a732f5 1073741824" returned: 0 in 0.839s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16e96008-8c90-40b8-a615-e5bee8a732f5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:34 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16e96008-8c90-40b8-a615-e5bee8a732f5 Sep 10 18:21:34 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:34 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16e96008-8c90-40b8-a615-e5bee8a732f5" returned: 0 in 0.337s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-cc58537a-d973-4fad-a347-4800fa508003 req-0b052d04-971c-4c26-a5e7-9b4554b78a9f tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.804s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e004b642-353b-4ea3-99ff-9aa48cd21c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16e96008-8c90-40b8-a615-e5bee8a732f5', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce69a7cb-c542-486b-89a9-f82d6069c44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-cc58537a-d973-4fad-a347-4800fa508003 req-0b052d04-971c-4c26-a5e7-9b4554b78a9f tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:34 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Volume volume-16e96008-8c90-40b8-a615-e5bee8a732f5 (16e96008-8c90-40b8-a615-e5bee8a732f5): created successfully Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce69a7cb-c542-486b-89a9-f82d6069c44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Flow 'volume_create_manager' (47584402-b139-47a5-b20d-0151455b42c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:21:34 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ee1ff85e-da53-4ad0-a294-c4149891f1c1 tempest-TaggedAttachmentsTest-1003080541 None] Created volume successfully. Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-cc58537a-d973-4fad-a347-4800fa508003 req-0b052d04-971c-4c26-a5e7-9b4554b78a9f tempest-ServerActionsTestOtherA-1901608082 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0a19352-9a6f-419b-8270-b2e6d8cb0249', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:21:34 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] group_snapshot ee1cb2b9-8293-4933-8a38-a10f89c978ce: deleting Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] group_snapshot ee1cb2b9-8293-4933-8a38-a10f89c978ce: deleting {{(pid=87842) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 10 18:21:34 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-cc58537a-d973-4fad-a347-4800fa508003 req-0b052d04-971c-4c26-a5e7-9b4554b78a9f tempest-ServerActionsTestOtherA-1901608082 None] attachment_update completed successfully. Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "cinder-quobyte-565db710-4a9c-49e1-acd1-79367585caa9" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-565db710-4a9c-49e1-acd1-79367585caa9" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "cinder-quobyte-01f02fd5-a686-473a-b5d6-ff76cd0f14cd" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-01f02fd5-a686-473a-b5d6-ff76cd0f14cd" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Deleting offline snapshot 01f02fd5-a686-473a-b5d6-ff76cd0f14cd of volume 565db710-4a9c-49e1-acd1-79367585caa9 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] snapshot_file for this snap is: volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8180975b-10d6-4c96-82e5-114cefa274c2]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:21:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:35 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd Sep 10 18:21:35 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:35 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd" returned: 0 in 0.604s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:35 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-565db710-4a9c-49e1-acd1-79367585caa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:21:35 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f43279-8d01-40ce-ae15-c471e8f84945]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:21:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:35 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9 Sep 10 18:21:35 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:36 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9" returned: 0 in 0.712s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:36 devstack sudo[90535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd Sep 10 18:21:36 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:37 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd" returned: 0 in 0.768s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:37 devstack sudo[90618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd Sep 10 18:21:37 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:37 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9.01f02fd5-a686-473a-b5d6-ff76cd0f14cd" returned: 0 in 0.440s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:37 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-01f02fd5-a686-473a-b5d6-ff76cd0f14cd" released by "_delete_snapshot" :: held 2.733s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:21:37 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-565db710-4a9c-49e1-acd1-79367585caa9" released by "delete_snapshot" :: held 2.803s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:21:37 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "cinder-quobyte-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:21:37 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:21:37 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "cinder-quobyte-2ba9cdd7-a280-45ab-9040-78ed977906f9" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:21:37 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-2ba9cdd7-a280-45ab-9040-78ed977906f9" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:21:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Deleting offline snapshot 2ba9cdd7-a280-45ab-9040-78ed977906f9 of volume 86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:21:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] snapshot_file for this snap is: volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:21:37 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2290a6b8-78a6-4067-843a-8a6632a019a1]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:21:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:37 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9 Sep 10 18:21:37 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:38 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9" returned: 0 in 0.738s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:21:38 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[313b3892-5911-4454-b274-5a5ebf302ff9]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:21:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:38 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 Sep 10 18:21:38 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:39 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8" returned: 0 in 0.726s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:39 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9 Sep 10 18:21:39 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:40 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9" returned: 0 in 0.835s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:40 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9 Sep 10 18:21:40 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:40 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8.2ba9cdd7-a280-45ab-9040-78ed977906f9" returned: 0 in 0.432s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-2ba9cdd7-a280-45ab-9040-78ed977906f9" released by "_delete_snapshot" :: held 2.920s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:21:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8" released by "delete_snapshot" :: held 2.977s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:21:40 devstack cinder-volume[87842]: WARNING cinder.quota [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-52840041 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-52840041, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:21:40 devstack cinder-volume[87842]: WARNING cinder.quota [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-52840041 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-52840041, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:21:40 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Created reservations ['288e50cb-b226-4475-bed9-61e36282fe0a', 'e9bd663c-488a-4146-b026-4d5bd037f38e', '70b90030-ba87-49fd-bd81-e3b13c8b0ba7', '9a910b02-e5f3-4c28-a021-bc978ffe6d69'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:21:41 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] Created reservations ['4cc359be-9a3f-4bbd-9bec-3b43802340bc', 'fe569a5c-c492-4703-8e5b-43b0a449fa8c', '6e95e20f-51be-45aa-9350-3660873e1382', '9ce9d1dc-c959-4eaf-a499-b4cd93bfcc38'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:21:41 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f49c4718-ae3a-47b9-a189-06473ac409ff tempest-GroupSnapshotsTest-1073590332 None] group_snapshot ee1cb2b9-8293-4933-8a38-a10f89c978ce: deleted successfully Sep 10 18:21:42 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "cinder-quobyte-565db710-4a9c-49e1-acd1-79367585caa9" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:21:42 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-565db710-4a9c-49e1-acd1-79367585caa9" acquired by "delete_volume" :: waited 0.027s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:21:42 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0459c75-6e14-491f-b9e1-58c0068aefce]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:21:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:42 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9 Sep 10 18:21:42 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:43 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9" returned: 0 in 0.659s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:43 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9 Sep 10 18:21:43 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:43 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-565db710-4a9c-49e1-acd1-79367585caa9" returned: 0 in 0.384s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-565db710-4a9c-49e1-acd1-79367585caa9" released by "delete_volume" :: held 1.177s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:21:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "cinder-quobyte-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:21:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8" acquired by "delete_volume" :: waited 0.031s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:21:43 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[17feb592-6051-414a-ba9a-5929d0381ce2]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:21:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:43 devstack sudo[91006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 Sep 10 18:21:43 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:44 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8" returned: 0 in 0.819s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:44 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8 Sep 10 18:21:44 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:44 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8" returned: 0 in 0.370s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:44 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-86b2fde8-64b4-4cd6-8671-4b2f6cb06aa8" released by "delete_volume" :: held 1.283s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:21:44 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Created reservations ['b8420080-c9e5-4958-b52c-9ae4fe740f54'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:21:45 devstack cinder-volume[87842]: WARNING cinder.quota [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-52840041 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-52840041, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:21:45 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Created reservations ['38457050-1910-4b41-9680-118766780008', '627da126-a346-4cd7-aa4c-7f153192f83e', '515e2d49-b621-48de-a721-5c295f469a9b', '309dee01-8524-4e29-8773-e9d58bf749b4'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:21:45 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Created reservations ['9cc281a0-e3db-42f7-b44b-a86c48a1921a', '3573cc37-8ba6-484e-97bf-d794a3b7cb6c', 'bf52e631-e5c0-4bdd-a087-3ca5ea26f8db', '27b2c475-5ee6-45f7-b9de-47d4e0e39417'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:21:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:21:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:21:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:45 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:21:45 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:45 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.457s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:45 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:21:45 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-fbf46e35-66d2-40bc-8584-f4547741212d tempest-GroupSnapshotsTest-1073590332 None] Delete group completed successfully. Sep 10 18:21:46 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-80c6fa2f-0c12-42e5-add8-334646c698d4 tempest-GroupSnapshotsTest-1073590332 None] Group tempest-GroupSnapshotsTest-Group-689763922: creating Sep 10 18:21:46 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-80c6fa2f-0c12-42e5-add8-334646c698d4 tempest-GroupSnapshotsTest-1073590332 None] Group tempest-GroupSnapshotsTest-Group-689763922: created successfully Sep 10 18:21:46 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-80c6fa2f-0c12-42e5-add8-334646c698d4 tempest-GroupSnapshotsTest-1073590332 None] Create group completed successfully. Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Flow 'volume_create_manager' (3dcbe79f-7d99-4843-ae9a-1c45d802524a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ddbe9d-a29a-4bb6-95bd-ca98e783dcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ddbe9d-a29a-4bb6-95bd-ca98e783dcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-706157348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=46505f4c-4bb8-4587-a478-541d3221dfaf,host='devstack@QuobyteHD#QuobyteHD',id=616849b4-e4f4-4340-80bd-f2600149ddac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b771bdd30f542b28ae74d7a159acf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:21:49Z,use_quota=True,user_id='00263234d1b54c7eb03633735aa5e82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17050441-97af-4d16-84b0-7ef52e5f0e24),volume_type_id=17050441-97af-4d16-84b0-7ef52e5f0e24)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6392e1ec-5f74-401b-881e-7476851211af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6392e1ec-5f74-401b-881e-7476851211af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92dceef-54eb-4b80-b86c-9517f4d08d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92dceef-54eb-4b80-b86c-9517f4d08d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '616849b4-e4f4-4340-80bd-f2600149ddac', 'volume_name': 'volume-616849b4-e4f4-4340-80bd-f2600149ddac', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d153250-d997-45a5-b633-6e21beee08f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d153250-d997-45a5-b633-6e21beee08f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8b466a-7ec1-448c-b404-dbf18c1018c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:49 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Volume 616849b4-e4f4-4340-80bd-f2600149ddac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-616849b4-e4f4-4340-80bd-f2600149ddac', 'volume_size': 1} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=46505f4c-4bb8-4587-a478-541d3221dfaf,created_at=2026-09-10T16:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-706157348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=46505f4c-4bb8-4587-a478-541d3221dfaf,host='devstack@QuobyteHD#QuobyteHD',id=616849b4-e4f4-4340-80bd-f2600149ddac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b771bdd30f542b28ae74d7a159acf88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:21:49Z,use_quota=True,user_id='00263234d1b54c7eb03633735aa5e82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17050441-97af-4d16-84b0-7ef52e5f0e24),volume_type_id=17050441-97af-4d16-84b0-7ef52e5f0e24)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Creating volume 616849b4-e4f4-4340-80bd-f2600149ddac {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:21:49 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:21:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:49 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac 1073741824 Sep 10 18:21:49 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:50 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac 1073741824" returned: 0 in 0.489s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:50 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac Sep 10 18:21:50 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:50 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac" returned: 0 in 0.415s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:21:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8b466a-7ec1-448c-b404-dbf18c1018c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-616849b4-e4f4-4340-80bd-f2600149ddac', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0b0893-339f-4284-8ad0-4a28657df451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:50 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Volume volume-616849b4-e4f4-4340-80bd-f2600149ddac (616849b4-e4f4-4340-80bd-f2600149ddac): created successfully Sep 10 18:21:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0b0893-339f-4284-8ad0-4a28657df451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Flow 'volume_create_manager' (3dcbe79f-7d99-4843-ae9a-1c45d802524a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:21:50 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ed21dcf8-05f9-466a-844d-bf431dcc59ab tempest-GroupSnapshotsTest-1073590332 None] Created volume successfully. Sep 10 18:21:52 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] GroupSnapshot 1bebc4ed-16b7-4f33-8938-1fbc4f7865cd: creating. Sep 10 18:21:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] Group snapshot 1bebc4ed-16b7-4f33-8938-1fbc4f7865cd: creating. {{(pid=87842) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 10 18:21:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] Creating offline snapshot fe269bb1-325b-4207-a70b-0e2adbd5425c of volume 616849b4-e4f4-4340-80bd-f2600149ddac {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:21:52 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6b3cb4-c6b2-4547-bf3e-35537fdb19a9]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:21:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:52 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac Sep 10 18:21:52 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:53 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac" returned: 0 in 0.563s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:53 devstack sudo[91150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c 1G Sep 10 18:21:53 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:53 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c 1G" returned: 0 in 0.733s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-616849b4-e4f4-4340-80bd-f2600149ddac -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:53 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-616849b4-e4f4-4340-80bd-f2600149ddac -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c Sep 10 18:21:53 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:54 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-616849b4-e4f4-4340-80bd-f2600149ddac -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c" returned: 0 in 0.379s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:54 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c is being set with open permissions: ugo+rw: NotImplementedError Sep 10 18:21:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:54 devstack sudo[91170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c Sep 10 18:21:54 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:54 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c" returned: 0 in 0.443s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:54 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.info Sep 10 18:21:54 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:55 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.info" returned: 0 in 0.371s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:55 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 18:21:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:55 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.info Sep 10 18:21:55 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:55 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.info" returned: 0 in 0.276s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.892s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:55 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c6200d5f-d2a4-4318-93c1-faa4ab20564c tempest-GroupSnapshotsTest-1073590332 None] group_snapshot 1bebc4ed-16b7-4f33-8938-1fbc4f7865cd: created successfully Sep 10 18:21:55 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] group_snapshot 1bebc4ed-16b7-4f33-8938-1fbc4f7865cd: deleting Sep 10 18:21:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] group_snapshot 1bebc4ed-16b7-4f33-8938-1fbc4f7865cd: deleting {{(pid=87842) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 10 18:21:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "cinder-quobyte-616849b4-e4f4-4340-80bd-f2600149ddac" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:21:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-616849b4-e4f4-4340-80bd-f2600149ddac" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:21:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "cinder-quobyte-fe269bb1-325b-4207-a70b-0e2adbd5425c" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:21:56 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-fe269bb1-325b-4207-a70b-0e2adbd5425c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:21:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] Deleting offline snapshot fe269bb1-325b-4207-a70b-0e2adbd5425c of volume 616849b4-e4f4-4340-80bd-f2600149ddac {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:21:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] snapshot_file for this snap is: volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:21:56 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a304f333-fbd8-4b8e-8a44-193e3d74066a]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:21:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:56 devstack sudo[91203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c Sep 10 18:21:56 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:56 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c" returned: 0 in 0.381s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-616849b4-e4f4-4340-80bd-f2600149ddac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:21:56 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0978a181-da5a-452a-bd7c-291390f7e744]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:21:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:56 devstack sudo[91232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac Sep 10 18:21:56 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:56 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac" returned: 0 in 0.371s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:56 devstack sudo[91237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c Sep 10 18:21:56 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:57 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c" returned: 0 in 0.323s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:57 devstack sudo[91242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c Sep 10 18:21:57 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:57 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac.fe269bb1-325b-4207-a70b-0e2adbd5425c" returned: 0 in 0.238s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:57 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-fe269bb1-325b-4207-a70b-0e2adbd5425c" released by "_delete_snapshot" :: held 1.437s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:21:57 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-616849b4-e4f4-4340-80bd-f2600149ddac" released by "delete_snapshot" :: held 1.473s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:21:57 devstack cinder-volume[87842]: WARNING cinder.quota [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2058170656 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2058170656, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:21:57 devstack cinder-volume[87842]: WARNING cinder.quota [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2058170656 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2058170656, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:21:57 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] Created reservations ['55da076c-731c-4bbd-b163-bdd86a8c5133', '3df812cc-7b2b-4ee2-8ddf-5dab7d6a07ac', '188e5f04-7f4c-4ef7-958e-cc1ce20b5902', '94594ea6-8178-4c23-b242-6a9cc5991feb'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:21:57 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c57cee42-9c57-4692-8d69-53c94e95e53b tempest-GroupSnapshotsTest-1073590332 None] group_snapshot 1bebc4ed-16b7-4f33-8938-1fbc4f7865cd: deleted successfully Sep 10 18:21:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2d74d647-9c5d-4495-a55f-22641d922ec3 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "cinder-quobyte-616849b4-e4f4-4340-80bd-f2600149ddac" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:21:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2d74d647-9c5d-4495-a55f-22641d922ec3 tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-616849b4-e4f4-4340-80bd-f2600149ddac" acquired by "delete_volume" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:21:58 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e74a370-dc94-4e81-a71c-501f7a43e533]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:21:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2d74d647-9c5d-4495-a55f-22641d922ec3 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:58 devstack sudo[91247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac Sep 10 18:21:58 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:58 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2d74d647-9c5d-4495-a55f-22641d922ec3 tempest-GroupSnapshotsTest-1073590332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac" returned: 0 in 0.373s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2d74d647-9c5d-4495-a55f-22641d922ec3 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:58 devstack sudo[91253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac Sep 10 18:21:58 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:59 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2d74d647-9c5d-4495-a55f-22641d922ec3 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-616849b4-e4f4-4340-80bd-f2600149ddac" returned: 0 in 0.270s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2d74d647-9c5d-4495-a55f-22641d922ec3 tempest-GroupSnapshotsTest-1073590332 None] Lock "cinder-quobyte-616849b4-e4f4-4340-80bd-f2600149ddac" released by "delete_volume" :: held 0.712s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-2d74d647-9c5d-4495-a55f-22641d922ec3 tempest-GroupSnapshotsTest-1073590332 None] Created reservations ['02ebbc95-16fe-409d-95d3-a5be90546880'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:21:59 devstack cinder-volume[87842]: WARNING cinder.quota [None req-2d74d647-9c5d-4495-a55f-22641d922ec3 tempest-GroupSnapshotsTest-1073590332 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2058170656 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2058170656, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-2d74d647-9c5d-4495-a55f-22641d922ec3 tempest-GroupSnapshotsTest-1073590332 None] Created reservations ['34d734a6-236e-43d2-af56-ba3a15745e29', 'e817d6ea-0314-44fc-923a-d4d5c7fca3eb', '7a8d5a06-2c40-4d1c-b7c0-30bf7edf15ff', 'c3ab5049-f5f2-4cf9-b0d5-a00483b0b674'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2d74d647-9c5d-4495-a55f-22641d922ec3 tempest-GroupSnapshotsTest-1073590332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2d74d647-9c5d-4495-a55f-22641d922ec3 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-2d74d647-9c5d-4495-a55f-22641d922ec3 tempest-GroupSnapshotsTest-1073590332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-2d74d647-9c5d-4495-a55f-22641d922ec3 tempest-GroupSnapshotsTest-1073590332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2d74d647-9c5d-4495-a55f-22641d922ec3 tempest-GroupSnapshotsTest-1073590332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2d74d647-9c5d-4495-a55f-22641d922ec3 tempest-GroupSnapshotsTest-1073590332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:59 devstack sudo[91257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:21:59 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:21:59 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Flow 'volume_create_manager' (1f4c29d9-e2b9-4c10-911c-04db8d36a017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861fbb57-70b8-4553-bc1c-7d5f9f7129c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2d74d647-9c5d-4495-a55f-22641d922ec3 tempest-GroupSnapshotsTest-1073590332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.416s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-2d74d647-9c5d-4495-a55f-22641d922ec3 tempest-GroupSnapshotsTest-1073590332 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861fbb57-70b8-4553-bc1c-7d5f9f7129c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-981074946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c8c40eb-b69c-4f00-80dc-a3e713c1f688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587713b75a1746c1a0cb11271b20a363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:22:00Z,use_quota=True,user_id='09802de5bc7f41dc8013ffb6f1256507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc203afc-63df-43f9-a854-9c52af662211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc203afc-63df-43f9-a854-9c52af662211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f796865-845c-42e7-9a45-e1d287c16876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f796865-845c-42e7-9a45-e1d287c16876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c8c40eb-b69c-4f00-80dc-a3e713c1f688', 'volume_name': 'volume-3c8c40eb-b69c-4f00-80dc-a3e713c1f688', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767c53e6-5a69-4ede-b5cd-1506714bb56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767c53e6-5a69-4ede-b5cd-1506714bb56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414d9229-f38f-41e6-bbf8-1eacddfb8399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:21:59 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Volume 3c8c40eb-b69c-4f00-80dc-a3e713c1f688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c8c40eb-b69c-4f00-80dc-a3e713c1f688', 'volume_size': 1} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-981074946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c8c40eb-b69c-4f00-80dc-a3e713c1f688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587713b75a1746c1a0cb11271b20a363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:22:00Z,use_quota=True,user_id='09802de5bc7f41dc8013ffb6f1256507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Creating volume 3c8c40eb-b69c-4f00-80dc-a3e713c1f688 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:21:59 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:21:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c8c40eb-b69c-4f00-80dc-a3e713c1f688 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:21:59 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-2d74d647-9c5d-4495-a55f-22641d922ec3 tempest-GroupSnapshotsTest-1073590332 None] Delete group completed successfully. Sep 10 18:22:00 devstack sudo[91260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c8c40eb-b69c-4f00-80dc-a3e713c1f688 1073741824 Sep 10 18:22:00 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:00 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c8c40eb-b69c-4f00-80dc-a3e713c1f688 1073741824" returned: 0 in 0.472s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c8c40eb-b69c-4f00-80dc-a3e713c1f688 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:00 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c8c40eb-b69c-4f00-80dc-a3e713c1f688 Sep 10 18:22:00 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:00 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c8c40eb-b69c-4f00-80dc-a3e713c1f688" returned: 0 in 0.300s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:00 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:22:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:22:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414d9229-f38f-41e6-bbf8-1eacddfb8399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c8c40eb-b69c-4f00-80dc-a3e713c1f688', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:22:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003ec17a-d5e1-48ae-b1de-4380fd8bc000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:22:00 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Volume volume-3c8c40eb-b69c-4f00-80dc-a3e713c1f688 (3c8c40eb-b69c-4f00-80dc-a3e713c1f688): created successfully Sep 10 18:22:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003ec17a-d5e1-48ae-b1de-4380fd8bc000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:22:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Flow 'volume_create_manager' (1f4c29d9-e2b9-4c10-911c-04db8d36a017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:22:00 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-14016eba-4eda-4adc-9b1a-b465ce7dee59 tempest-AttachVolumeNegativeTest-1370217353 None] Created volume successfully. Sep 10 18:22:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-e149d776-f49c-4465-a89b-76ae1c4f94d5 req-69ed22a2-4515-4532-a1b1-4bd1d97b2732 tempest-AttachVolumeNegativeTest-1370217353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:22:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-e149d776-f49c-4465-a89b-76ae1c4f94d5 req-69ed22a2-4515-4532-a1b1-4bd1d97b2732 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:22:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-e149d776-f49c-4465-a89b-76ae1c4f94d5 req-69ed22a2-4515-4532-a1b1-4bd1d97b2732 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:22:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-e149d776-f49c-4465-a89b-76ae1c4f94d5 req-69ed22a2-4515-4532-a1b1-4bd1d97b2732 tempest-AttachVolumeNegativeTest-1370217353 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-3c8c40eb-b69c-4f00-80dc-a3e713c1f688', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6a15cfa-44e7-41c8-9337-35128963f6df', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:22:03 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-e149d776-f49c-4465-a89b-76ae1c4f94d5 req-69ed22a2-4515-4532-a1b1-4bd1d97b2732 tempest-AttachVolumeNegativeTest-1370217353 None] attachment_update completed successfully. Sep 10 18:22:08 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:UPDATE=110,cinder:INSERT=26,cinder:SELECT=118,cinder:DELETE=2 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:22:08 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=128,cinder:UPDATE=107,cinder:INSERT=23,cinder:DELETE=3 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:22:08 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-577c6ca4-5b2d-4e97-b669-6a596052c350 req-f8307330-eb2b-4c9c-8ac9-c6e1ceaf7d0c tempest-ServerActionsTestOtherA-1901608082 None] Terminate volume connection completed successfully. Sep 10 18:22:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-577c6ca4-5b2d-4e97-b669-6a596052c350 req-f8307330-eb2b-4c9c-8ac9-c6e1ceaf7d0c tempest-ServerActionsTestOtherA-1901608082 None] Deleting attachment b0a19352-9a6f-419b-8270-b2e6d8cb0249. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:22:18 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:22:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Flow 'volume_create_manager' (a9167c66-2ee4-4208-97e7-4ec11b1c284a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:22:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0724d0-a71f-4130-a72a-cd380e969a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:22:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0724d0-a71f-4130-a72a-cd380e969a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-952280676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4462c8e0-ce75-46c5-91a3-0ea773b2a298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fb9050ce77463595102dbb2bc90b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:22:18Z,use_quota=True,user_id='37b588b06fee46f2b24f8526f74a0667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:22:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bdded6e-1f8b-4a92-b3fb-f5c0dd506027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:22:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bdded6e-1f8b-4a92-b3fb-f5c0dd506027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:22:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52ef380-a173-461a-aa69-d744e8a22fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:22:18 devstack cinder-volume[87842]: DEBUG cinder.image.glance [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Creating Keystone auth plugin from conf {{(pid=87842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 18:22:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52ef380-a173-461a-aa69-d744e8a22fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4462c8e0-ce75-46c5-91a3-0ea773b2a298', 'volume_name': 'volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298', 'volume_size': 1, 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12fe9fd924464f1896748c45b7609239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'created_at': datetime.datetime(2026, 9, 10, 16, 14, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 14, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0312d110-0baa-405f-96b9-31d6f3adc458/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:22:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44f826a-6159-469e-a3e4-d430d6080f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:22:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44f826a-6159-469e-a3e4-d430d6080f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:22:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143d9138-8689-4539-9b60-feda67a70c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:22:18 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Volume 4462c8e0-ce75-46c5-91a3-0ea773b2a298: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298', 'volume_size': 1, 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12fe9fd924464f1896748c45b7609239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'created_at': datetime.datetime(2026, 9, 10, 16, 14, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 14, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0312d110-0baa-405f-96b9-31d6f3adc458/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 18:22:18 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Trying to clone 4462c8e0-ce75-46c5-91a3-0ea773b2a298 from image 0312d110-0baa-405f-96b9-31d6f3adc458 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]). {{(pid=87842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 18:22:19 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_99fsxb2bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 18:22:19 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Image download 20.69 MB at 20.69 MB/s Sep 10 18:22:19 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf75c3a8-bfc5-4cbc-8ff3-4aaea24f6ba5]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:22:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_99fsxb2bdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:19 devstack sudo[91485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_99fsxb2bdevstack@QuobyteHD Sep 10 18:22:19 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:20 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_99fsxb2bdevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:20 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Temporary image 0312d110-0baa-405f-96b9-31d6f3adc458 is fetched for user 37b588b06fee46f2b24f8526f74a0667. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 18:22:20 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53add85-87c8-4365-a074-568ebcc4da26]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:22:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_99fsxb2bdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:20 devstack sudo[91491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_99fsxb2bdevstack@QuobyteHD Sep 10 18:22:20 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:21 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_99fsxb2bdevstack@QuobyteHD" returned: 0 in 1.006s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:22:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:22:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-952280676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4462c8e0-ce75-46c5-91a3-0ea773b2a298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fb9050ce77463595102dbb2bc90b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:22:18Z,use_quota=True,user_id='37b588b06fee46f2b24f8526f74a0667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:22:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Creating volume 4462c8e0-ce75-46c5-91a3-0ea773b2a298 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:22:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:22:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:22:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:22:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:22:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:22:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:22:21 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:22:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:21 devstack sudo[91532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298 1073741824 Sep 10 18:22:21 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:22 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298 1073741824" returned: 0 in 0.884s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:22 devstack sudo[91556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298 Sep 10 18:22:22 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:22 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298" returned: 0 in 0.452s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:22:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:22:22 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Attempting download of 0312d110-0baa-405f-96b9-31d6f3adc458 ((None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}])) to volume 4462c8e0-ce75-46c5-91a3-0ea773b2a298. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 18:22:22 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4f6e19-2a41-40ee-a7e5-6c285f83a427]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:22:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_v1sq2xl5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:22 devstack sudo[91562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_v1sq2xl5 Sep 10 18:22:22 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-69a0d28e-21c3-4794-a0d0-0e4a9e3b519d req-497751c5-46e7-4ef8-a0bb-f683570a33f8 tempest-TaggedAttachmentsTest-1003080541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:22:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-69a0d28e-21c3-4794-a0d0-0e4a9e3b519d req-497751c5-46e7-4ef8-a0bb-f683570a33f8 tempest-TaggedAttachmentsTest-1003080541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:22:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-69a0d28e-21c3-4794-a0d0-0e4a9e3b519d req-497751c5-46e7-4ef8-a0bb-f683570a33f8 tempest-TaggedAttachmentsTest-1003080541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:22:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-69a0d28e-21c3-4794-a0d0-0e4a9e3b519d req-497751c5-46e7-4ef8-a0bb-f683570a33f8 tempest-TaggedAttachmentsTest-1003080541 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-16e96008-8c90-40b8-a615-e5bee8a732f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '423f2bdb-8f2c-4137-9ae6-eaa4c6403d06', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:22:23 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_v1sq2xl5" returned: 0 in 0.406s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_v1sq2xl5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:23 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-69a0d28e-21c3-4794-a0d0-0e4a9e3b519d req-497751c5-46e7-4ef8-a0bb-f683570a33f8 tempest-TaggedAttachmentsTest-1003080541 None] attachment_update completed successfully. Sep 10 18:22:23 devstack sudo[91574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_v1sq2xl5 Sep 10 18:22:23 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:23 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_v1sq2xl5" returned: 1 in 0.552s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_v1sq2xl5' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:22:23 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[23acd954-55b0-4c3e-91b9-170008af0d77]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:22:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_99fsxb2bdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:23 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_99fsxb2bdevstack@QuobyteHD Sep 10 18:22:23 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:24 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_99fsxb2bdevstack@QuobyteHD" returned: 0 in 0.530s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:24 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] 0312d110-0baa-405f-96b9-31d6f3adc458 was qcow2, converting to qcow2 {{(pid=87842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 18:22:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_99fsxb2bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:24 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_99fsxb2bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298 Sep 10 18:22:24 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:26 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f9575d1a-a766-4c6d-9dfa-43858c985084 tempest-GroupsV314Test-990333820 None] Group tempest-GroupsV314Test-Group-1365788628: creating Sep 10 18:22:26 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f9575d1a-a766-4c6d-9dfa-43858c985084 tempest-GroupsV314Test-990333820 None] Group tempest-GroupsV314Test-Group-1365788628: created successfully Sep 10 18:22:26 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f9575d1a-a766-4c6d-9dfa-43858c985084 tempest-GroupsV314Test-990333820 None] Create group completed successfully. Sep 10 18:22:26 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_99fsxb2bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298" returned: 0 in 2.116s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:26 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_99fsxb2bdevstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298 {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:22:26 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Converted 112.00 MB image at 52.90 MB/s Sep 10 18:22:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:26 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298 1G Sep 10 18:22:26 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:26 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298 1G" returned: 0 in 0.417s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:26 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Downloaded image 0312d110-0baa-405f-96b9-31d6f3adc458 ((None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}])) to volume 4462c8e0-ce75-46c5-91a3-0ea773b2a298 successfully. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 18:22:26 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Temporary image 0312d110-0baa-405f-96b9-31d6f3adc458 for user 37b588b06fee46f2b24f8526f74a0667 is deleted. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 18:22:26 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Marking volume 4462c8e0-ce75-46c5-91a3-0ea773b2a298 as bootable. {{(pid=87842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 18:22:26 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Copying metadata from image 0312d110-0baa-405f-96b9-31d6f3adc458 to 4462c8e0-ce75-46c5-91a3-0ea773b2a298. {{(pid=87842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 18:22:26 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Creating volume glance metadata for volume 4462c8e0-ce75-46c5-91a3-0ea773b2a298 backed by image 0312d110-0baa-405f-96b9-31d6f3adc458 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 18:22:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143d9138-8689-4539-9b60-feda67a70c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298', 'volume_size': 1, 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12fe9fd924464f1896748c45b7609239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'created_at': datetime.datetime(2026, 9, 10, 16, 14, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 14, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0312d110-0baa-405f-96b9-31d6f3adc458/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:22:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e826367-1cf4-40cb-83ff-5cc22712ef27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:22:26 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Volume volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298 (4462c8e0-ce75-46c5-91a3-0ea773b2a298): created successfully Sep 10 18:22:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e826367-1cf4-40cb-83ff-5cc22712ef27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:22:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Flow 'volume_create_manager' (a9167c66-2ee4-4208-97e7-4ec11b1c284a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:22:26 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-5bb21810-60e6-4507-9d3b-bd815ee4c9ac tempest-ServerActionsTestOtherA-1901608082 None] Created volume successfully. Sep 10 18:22:27 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-a16c6e41-2544-4f3c-851e-2dd024e33ba3 req-387d7ee3-1369-4fd9-be58-897f78d533f0 tempest-TaggedAttachmentsTest-1003080541 None] Terminate volume connection completed successfully. Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-a16c6e41-2544-4f3c-851e-2dd024e33ba3 req-387d7ee3-1369-4fd9-be58-897f78d533f0 tempest-TaggedAttachmentsTest-1003080541 None] Deleting attachment 423f2bdb-8f2c-4137-9ae6-eaa4c6403d06. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Flow 'volume_create_manager' (ebddbcaf-487e-4fb5-8f7d-d912d80a5f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09494b88-ca65-44ff-93dd-38fd86fdcf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09494b88-ca65-44ff-93dd-38fd86fdcf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-817220540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=500c5c32-3d57-4627-be1b-4f9ebab23bd4,host='devstack@QuobyteHD#QuobyteHD',id=f7945a76-ef5d-4542-9f5f-13d796129cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7839653c7afb46f9894f9278382582bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:22:28Z,use_quota=True,user_id='7e6f6b34667a46d98df6f7b1e400cac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(029c6eb0-78b3-4388-b316-a703383db796),volume_type_id=029c6eb0-78b3-4388-b316-a703383db796)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f740e8d6-359a-4489-b35d-54434b696306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f740e8d6-359a-4489-b35d-54434b696306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08463702-54d5-4e86-9bfb-0017abdd1d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08463702-54d5-4e86-9bfb-0017abdd1d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7945a76-ef5d-4542-9f5f-13d796129cb3', 'volume_name': 'volume-f7945a76-ef5d-4542-9f5f-13d796129cb3', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81043884-b4f1-4880-80ea-b48858591ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81043884-b4f1-4880-80ea-b48858591ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f59b85-c48e-49c1-bd35-ddb6ef2285a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:22:27 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Volume f7945a76-ef5d-4542-9f5f-13d796129cb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7945a76-ef5d-4542-9f5f-13d796129cb3', 'volume_size': 1} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=500c5c32-3d57-4627-be1b-4f9ebab23bd4,created_at=2026-09-10T16:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-817220540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=500c5c32-3d57-4627-be1b-4f9ebab23bd4,host='devstack@QuobyteHD#QuobyteHD',id=f7945a76-ef5d-4542-9f5f-13d796129cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7839653c7afb46f9894f9278382582bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:22:28Z,use_quota=True,user_id='7e6f6b34667a46d98df6f7b1e400cac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(029c6eb0-78b3-4388-b316-a703383db796),volume_type_id=029c6eb0-78b3-4388-b316-a703383db796)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Creating volume f7945a76-ef5d-4542-9f5f-13d796129cb3 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:22:27 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:22:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:27 devstack sudo[91658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 1073741824 Sep 10 18:22:27 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:28 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 1073741824" returned: 0 in 0.754s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:28 devstack sudo[91682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 Sep 10 18:22:28 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:28 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3" returned: 0 in 0.313s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:22:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:22:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f59b85-c48e-49c1-bd35-ddb6ef2285a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7945a76-ef5d-4542-9f5f-13d796129cb3', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:22:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb36a8a-a3e8-45b6-9427-db397a7021d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:22:29 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Volume volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 (f7945a76-ef5d-4542-9f5f-13d796129cb3): created successfully Sep 10 18:22:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb36a8a-a3e8-45b6-9427-db397a7021d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:22:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Flow 'volume_create_manager' (ebddbcaf-487e-4fb5-8f7d-d912d80a5f3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:22:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:22:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:22:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:22:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:22:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:22:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:22:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:29 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f27d57b5-37af-42c4-bb48-85cc3b973020 tempest-GroupsV314Test-990333820 None] Created volume successfully. Sep 10 18:22:29 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:22:29 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:29 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.277s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:22:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:22:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 28 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:22:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:22:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:22:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:22:30 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Cloning volume f7945a76-ef5d-4542-9f5f-13d796129cb3 to volume 9507a790-d767-4c3e-a999-ffe7ad3dedb1 Sep 10 18:22:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Creating offline snapshot 04034a3d-632d-4d20-b5c3-19883231d7e6 of volume f7945a76-ef5d-4542-9f5f-13d796129cb3 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:22:31 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df2c410-7987-4f7a-9bba-6496c49bae56]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:22:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:31 devstack sudo[91701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 Sep 10 18:22:31 devstack sudo[91701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:31 devstack sudo[91701]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3" returned: 0 in 0.492s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:31 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6 1G Sep 10 18:22:31 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-4f9b4eee-886b-48fa-81d7-2c4377ce4eab req-82f333d2-6a14-4b6e-8bc7-986a03fdf513 tempest-ServerActionsTestOtherA-1901608082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:22:31 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6 1G" returned: 0 in 0.497s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:32 devstack sudo[91722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6 Sep 10 18:22:32 devstack sudo[91722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:32 devstack sudo[91722]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6" returned: 0 in 0.346s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:32 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 18:22:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:32 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6 Sep 10 18:22:32 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:32 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6" returned: 0 in 0.371s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:32 devstack sudo[91733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.info Sep 10 18:22:32 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:33 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.info" returned: 0 in 0.377s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:33 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 18:22:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:33 devstack sudo[91756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.info Sep 10 18:22:33 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:33 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.info" returned: 0 in 0.337s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Acquiring lock "cinder-quobyte-9507a790-d767-4c3e-a999-ffe7ad3dedb1" by "_copy_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:22:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Lock "cinder-quobyte-9507a790-d767-4c3e-a999-ffe7ad3dedb1" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:22:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] snapshot: 04034a3d-632d-4d20-b5c3-19883231d7e6, volume: 9507a790-d767-4c3e-a999-ffe7ad3dedb1, {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 18:22:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:22:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:22:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:22:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:22:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:22:33 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f42749-fb4c-460c-b278-fa657173285a]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:22:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:33 devstack sudo[91762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6 Sep 10 18:22:33 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:34 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6" returned: 0 in 0.609s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7945a76-ef5d-4542-9f5f-13d796129cb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:22:34 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b2f0f3-1970-4664-a44d-9c5ec2a2f204]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:22:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:34 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 Sep 10 18:22:34 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:34 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3" returned: 0 in 0.420s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 18:22:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Creating direct copy from snapshot {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 18:22:34 devstack cinder-volume[87842]: DEBUG cinder.utils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Path /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9507a790-d767-4c3e-a999-ffe7ad3dedb1 not found in is_blk_device check {{(pid=87842) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 18:22:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9507a790-d767-4c3e-a999-ffe7ad3dedb1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:34 devstack sudo[91775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9507a790-d767-4c3e-a999-ffe7ad3dedb1 Sep 10 18:22:34 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:41 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9507a790-d767-4c3e-a999-ffe7ad3dedb1" returned: 0 in 6.995s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:41 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Image conversion details: src /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3, size 1024.00 MB, duration 7.00 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9507a790-d767-4c3e-a999-ffe7ad3dedb1 {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:22:41 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Converted 1024.00 MB image at 146.36 MB/s Sep 10 18:22:41 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9507a790-d767-4c3e-a999-ffe7ad3dedb1 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 18:22:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9507a790-d767-4c3e-a999-ffe7ad3dedb1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:41 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9507a790-d767-4c3e-a999-ffe7ad3dedb1 Sep 10 18:22:41 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:41 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9507a790-d767-4c3e-a999-ffe7ad3dedb1" returned: 0 in 0.324s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Lock "cinder-quobyte-9507a790-d767-4c3e-a999-ffe7ad3dedb1" released by "_copy_volume_from_snapshot" :: held 8.438s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:22:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Acquiring lock "cinder-quobyte-04034a3d-632d-4d20-b5c3-19883231d7e6" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:22:42 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Lock "cinder-quobyte-04034a3d-632d-4d20-b5c3-19883231d7e6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:22:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Deleting offline snapshot 04034a3d-632d-4d20-b5c3-19883231d7e6 of volume f7945a76-ef5d-4542-9f5f-13d796129cb3 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:22:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] snapshot_file for this snap is: volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:22:42 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb5a85f-8480-4128-87e8-5e83db55fc88]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:22:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:42 devstack sudo[91825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6 Sep 10 18:22:42 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:42 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6" returned: 0 in 0.390s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7945a76-ef5d-4542-9f5f-13d796129cb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:22:42 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ff09f2-12f7-49b1-99ab-2a49e741e084]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:22:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:42 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 Sep 10 18:22:42 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:42 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=25,cinder:UPDATE=12,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:22:43 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3" returned: 0 in 0.647s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:43 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6 Sep 10 18:22:43 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:43 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6" returned: 0 in 0.451s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:43 devstack sudo[91846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6 Sep 10 18:22:43 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] Acquiring lock "cinder-16e96008-8c90-40b8-a615-e5bee8a732f5-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:22:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] Lock "cinder-16e96008-8c90-40b8-a615-e5bee8a732f5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:22:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] Acquiring lock "cinder-quobyte-16e96008-8c90-40b8-a615-e5bee8a732f5" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:22:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] Lock "cinder-quobyte-16e96008-8c90-40b8-a615-e5bee8a732f5" acquired by "delete_volume" :: waited 0.020s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:22:43 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d19f63-b68e-4d96-a994-7bc1f855c372]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:22:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16e96008-8c90-40b8-a615-e5bee8a732f5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:43 devstack sudo[91848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16e96008-8c90-40b8-a615-e5bee8a732f5 Sep 10 18:22:43 devstack sudo[91848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:43 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3.04034a3d-632d-4d20-b5c3-19883231d7e6" returned: 0 in 0.310s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Lock "cinder-quobyte-04034a3d-632d-4d20-b5c3-19883231d7e6" released by "_delete_snapshot" :: held 1.915s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:22:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:22:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-4f9b4eee-886b-48fa-81d7-2c4377ce4eab req-82f333d2-6a14-4b6e-8bc7-986a03fdf513 tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.339s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:22:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-4f9b4eee-886b-48fa-81d7-2c4377ce4eab req-82f333d2-6a14-4b6e-8bc7-986a03fdf513 tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:22:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-4f9b4eee-886b-48fa-81d7-2c4377ce4eab req-82f333d2-6a14-4b6e-8bc7-986a03fdf513 tempest-ServerActionsTestOtherA-1901608082 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02fd149e-6f45-48a9-9608-07af4e951a05', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:22:44 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-b2c9199c-078c-485c-b154-77abce040de3 tempest-GroupsV314Test-990333820 None] Create group from source-group-500c5c32-3d57-4627-be1b-4f9ebab23bd4 completed successfully. Sep 10 18:22:44 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-4f9b4eee-886b-48fa-81d7-2c4377ce4eab req-82f333d2-6a14-4b6e-8bc7-986a03fdf513 tempest-ServerActionsTestOtherA-1901608082 None] attachment_update completed successfully. Sep 10 18:22:44 devstack sudo[91848]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16e96008-8c90-40b8-a615-e5bee8a732f5" returned: 0 in 0.403s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16e96008-8c90-40b8-a615-e5bee8a732f5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:44 devstack sudo[91854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16e96008-8c90-40b8-a615-e5bee8a732f5 Sep 10 18:22:44 devstack sudo[91854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:44 devstack sudo[91854]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16e96008-8c90-40b8-a615-e5bee8a732f5" returned: 0 in 0.294s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:44 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] Lock "cinder-quobyte-16e96008-8c90-40b8-a615-e5bee8a732f5" released by "delete_volume" :: held 0.751s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:22:44 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] Created reservations ['0321d551-b894-4c84-8319-13d7e7112a6b', '34fb2789-8001-4050-81f7-1b2331c57486', '0d5d7db6-b64c-4950-bb4a-c0972af6b569', 'f0c81fb9-cd5d-46f7-90e9-4b0c110f15f4'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:22:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:22:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:22:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:22:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:22:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:22:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:44 devstack sudo[91871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:22:44 devstack sudo[91871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:45 devstack sudo[91871]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.431s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:45 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:22:45 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] Deleted volume successfully. Sep 10 18:22:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1d40609b-3167-4119-ba2a-a0b40c944fc6 tempest-TaggedAttachmentsTest-1003080541 None] Lock "cinder-16e96008-8c90-40b8-a615-e5bee8a732f5-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:22:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] Acquiring lock "cinder-quobyte-9507a790-d767-4c3e-a999-ffe7ad3dedb1" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:22:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] Lock "cinder-quobyte-9507a790-d767-4c3e-a999-ffe7ad3dedb1" acquired by "delete_volume" :: waited 0.037s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:22:45 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ed873a-f83b-4c36-b552-2f6ac4ec98c8]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:22:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9507a790-d767-4c3e-a999-ffe7ad3dedb1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:46 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9507a790-d767-4c3e-a999-ffe7ad3dedb1 Sep 10 18:22:46 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:46 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-a5bfc4d7-26e5-4159-8db8-faa1531ed937 req-1fe53de1-9e8f-4f57-8934-613502508ea6 tempest-AttachVolumeNegativeTest-1370217353 None] Terminate volume connection completed successfully. Sep 10 18:22:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-a5bfc4d7-26e5-4159-8db8-faa1531ed937 req-1fe53de1-9e8f-4f57-8934-613502508ea6 tempest-AttachVolumeNegativeTest-1370217353 None] Deleting attachment d6a15cfa-44e7-41c8-9337-35128963f6df. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:22:46 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9507a790-d767-4c3e-a999-ffe7ad3dedb1" returned: 0 in 0.563s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9507a790-d767-4c3e-a999-ffe7ad3dedb1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:46 devstack sudo[91911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9507a790-d767-4c3e-a999-ffe7ad3dedb1 Sep 10 18:22:46 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:46 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9507a790-d767-4c3e-a999-ffe7ad3dedb1" returned: 0 in 0.562s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:47 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] Lock "cinder-quobyte-9507a790-d767-4c3e-a999-ffe7ad3dedb1" released by "delete_volume" :: held 1.239s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:22:47 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] Created reservations ['727bdf05-074b-4638-85cc-75ddb505e253'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:22:47 devstack cinder-volume[87842]: WARNING cinder.quota [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1708286155 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1708286155, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:22:47 devstack cinder-volume[87842]: WARNING cinder.quota [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1708286155 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1708286155, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:22:47 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] Created reservations ['7371b1b6-b053-4e5b-a263-c18eee9bb28a', 'e14b6163-c7b7-4dce-99dd-bdd06ee6e11d', 'fd1b15e3-70c3-494b-aeb9-bc9d4e164d56', '30462f2f-a4ce-4145-b2aa-d1a618da3b99'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:22:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:22:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:22:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:22:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:22:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:22:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:47 devstack sudo[91914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:22:47 devstack sudo[91914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:47 devstack sudo[91914]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.393s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:47 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:22:47 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e926f01d-b1e1-4eab-9772-cd25a2dc05bd tempest-GroupsV314Test-990333820 None] Delete group completed successfully. Sep 10 18:22:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-669b37d8-e386-497f-b29d-3b7b9b849a6c tempest-GroupsV314Test-990333820 None] Acquiring lock "cinder-quobyte-f7945a76-ef5d-4542-9f5f-13d796129cb3" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:22:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-669b37d8-e386-497f-b29d-3b7b9b849a6c tempest-GroupsV314Test-990333820 None] Lock "cinder-quobyte-f7945a76-ef5d-4542-9f5f-13d796129cb3" acquired by "delete_volume" :: waited 0.028s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:22:48 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2115317-1cb4-45ac-a4b0-db43e6e3895e]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:22:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-669b37d8-e386-497f-b29d-3b7b9b849a6c tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:49 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 Sep 10 18:22:49 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:49 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-669b37d8-e386-497f-b29d-3b7b9b849a6c tempest-GroupsV314Test-990333820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3" returned: 0 in 0.550s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-669b37d8-e386-497f-b29d-3b7b9b849a6c tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:49 devstack sudo[91953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3 Sep 10 18:22:49 devstack sudo[91953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:49 devstack sudo[91953]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-669b37d8-e386-497f-b29d-3b7b9b849a6c tempest-GroupsV314Test-990333820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f7945a76-ef5d-4542-9f5f-13d796129cb3" returned: 0 in 0.410s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-669b37d8-e386-497f-b29d-3b7b9b849a6c tempest-GroupsV314Test-990333820 None] Lock "cinder-quobyte-f7945a76-ef5d-4542-9f5f-13d796129cb3" released by "delete_volume" :: held 1.137s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:22:50 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-669b37d8-e386-497f-b29d-3b7b9b849a6c tempest-GroupsV314Test-990333820 None] Created reservations ['0cb04107-ab1c-42d5-928e-77cd2a3d5e13'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:22:50 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-669b37d8-e386-497f-b29d-3b7b9b849a6c tempest-GroupsV314Test-990333820 None] Created reservations ['8eace2a4-d492-4948-8672-2847ffdb3960', '25bb5905-b057-4530-81b0-5e765145e16b', 'ac80aa0a-0fe2-4eb1-bd1b-fe4bdc1f0105', '98756484-4391-4ab6-9368-c694db6d7003'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:22:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-669b37d8-e386-497f-b29d-3b7b9b849a6c tempest-GroupsV314Test-990333820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:22:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-669b37d8-e386-497f-b29d-3b7b9b849a6c tempest-GroupsV314Test-990333820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:22:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-669b37d8-e386-497f-b29d-3b7b9b849a6c tempest-GroupsV314Test-990333820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:22:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-669b37d8-e386-497f-b29d-3b7b9b849a6c tempest-GroupsV314Test-990333820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:22:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-669b37d8-e386-497f-b29d-3b7b9b849a6c tempest-GroupsV314Test-990333820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:22:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-669b37d8-e386-497f-b29d-3b7b9b849a6c tempest-GroupsV314Test-990333820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:22:50 devstack sudo[91958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:22:50 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:22:51 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root Sep 10 18:22:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-669b37d8-e386-497f-b29d-3b7b9b849a6c tempest-GroupsV314Test-990333820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.427s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:22:51 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-669b37d8-e386-497f-b29d-3b7b9b849a6c tempest-GroupsV314Test-990333820 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:22:51 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-669b37d8-e386-497f-b29d-3b7b9b849a6c tempest-GroupsV314Test-990333820 None] Delete group completed successfully. Sep 10 18:23:00 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:UPDATE=28,cinder:SELECT=35,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:23:00 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=53,cinder:UPDATE=49,cinder:INSERT=11 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:23:03 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-ec67f53d-9b51-4cba-a641-3f36aebb63f1 req-56c99c50-9a8f-4a43-affe-706980b6e78e tempest-ServerActionsTestOtherA-1901608082 None] Terminate volume connection completed successfully. Sep 10 18:23:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-ec67f53d-9b51-4cba-a641-3f36aebb63f1 req-56c99c50-9a8f-4a43-affe-706980b6e78e tempest-ServerActionsTestOtherA-1901608082 None] Deleting attachment 02fd149e-6f45-48a9-9608-07af4e951a05. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:23:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-ec67f53d-9b51-4cba-a641-3f36aebb63f1 req-1d8d4d50-dec4-40dc-8423-1cacd15c7734 tempest-ServerActionsTestOtherA-1901608082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:23:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-ec67f53d-9b51-4cba-a641-3f36aebb63f1 req-1d8d4d50-dec4-40dc-8423-1cacd15c7734 tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:23:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-ec67f53d-9b51-4cba-a641-3f36aebb63f1 req-1d8d4d50-dec4-40dc-8423-1cacd15c7734 tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:23:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-ec67f53d-9b51-4cba-a641-3f36aebb63f1 req-1d8d4d50-dec4-40dc-8423-1cacd15c7734 tempest-ServerActionsTestOtherA-1901608082 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df219e87-b73c-466f-a0fe-cdbc99a74ddd', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:23:06 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-ec67f53d-9b51-4cba-a641-3f36aebb63f1 req-1d8d4d50-dec4-40dc-8423-1cacd15c7734 tempest-ServerActionsTestOtherA-1901608082 None] attachment_update completed successfully. Sep 10 18:23:16 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:23:16 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:23:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:23:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:23:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:23:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:23:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:23:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:23:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:23:29 devstack sudo[92668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:23:29 devstack sudo[92668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:23:29 devstack sudo[92668]: pam_unix(sudo:session): session closed for user root Sep 10 18:23:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.428s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:23:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:23:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:23:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 28 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:23:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Flow 'volume_create_manager' (309f92d1-c625-49e3-82a8-34832d855078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4969cd9-792d-4b9c-b5db-8250c91e9429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4969cd9-792d-4b9c-b5db-8250c91e9429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1979813220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a971f483-63ea-420b-96fa-2a97e6cd5880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38096d99df064a038605f35f6a24bb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:23:33Z,use_quota=True,user_id='fe8d0f1f71504f75b5bcdca9a3b3c6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe9095f-07be-4534-8a01-88a50826669e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe9095f-07be-4534-8a01-88a50826669e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d779322-7ac3-4c47-a940-ca9972656afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d779322-7ac3-4c47-a940-ca9972656afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a971f483-63ea-420b-96fa-2a97e6cd5880', 'volume_name': 'volume-a971f483-63ea-420b-96fa-2a97e6cd5880', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7dcd66-ac72-430b-88bb-72697915dab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7dcd66-ac72-430b-88bb-72697915dab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfefc6da-a39e-4cac-ae62-aa04967eb46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:23:32 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Volume a971f483-63ea-420b-96fa-2a97e6cd5880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a971f483-63ea-420b-96fa-2a97e6cd5880', 'volume_size': 1} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1979813220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a971f483-63ea-420b-96fa-2a97e6cd5880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38096d99df064a038605f35f6a24bb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:23:33Z,use_quota=True,user_id='fe8d0f1f71504f75b5bcdca9a3b3c6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Creating volume a971f483-63ea-420b-96fa-2a97e6cd5880 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:23:32 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:23:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a971f483-63ea-420b-96fa-2a97e6cd5880 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:23:32 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a971f483-63ea-420b-96fa-2a97e6cd5880 1073741824 Sep 10 18:23:32 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:23:33 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Sep 10 18:23:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a971f483-63ea-420b-96fa-2a97e6cd5880 1073741824" returned: 0 in 0.854s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:23:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a971f483-63ea-420b-96fa-2a97e6cd5880 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:23:33 devstack sudo[92783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a971f483-63ea-420b-96fa-2a97e6cd5880 Sep 10 18:23:33 devstack sudo[92783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:23:34 devstack sudo[92783]: pam_unix(sudo:session): session closed for user root Sep 10 18:23:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a971f483-63ea-420b-96fa-2a97e6cd5880" returned: 0 in 0.567s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:23:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:23:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:23:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfefc6da-a39e-4cac-ae62-aa04967eb46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a971f483-63ea-420b-96fa-2a97e6cd5880', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:23:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636d49c3-0c54-4247-8952-61bb164adc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:23:34 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Volume volume-a971f483-63ea-420b-96fa-2a97e6cd5880 (a971f483-63ea-420b-96fa-2a97e6cd5880): created successfully Sep 10 18:23:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636d49c3-0c54-4247-8952-61bb164adc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:23:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Flow 'volume_create_manager' (309f92d1-c625-49e3-82a8-34832d855078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:23:34 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-7c5ea17a-aacf-48a9-b549-c1a59e61f6c3 tempest-VolumeQuotasNegativeTestJSON-410428612 None] Created volume successfully. Sep 10 18:23:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] Acquiring lock "cinder-a971f483-63ea-420b-96fa-2a97e6cd5880-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:23:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] Lock "cinder-a971f483-63ea-420b-96fa-2a97e6cd5880-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:23:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] Acquiring lock "cinder-quobyte-a971f483-63ea-420b-96fa-2a97e6cd5880" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:23:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] Lock "cinder-quobyte-a971f483-63ea-420b-96fa-2a97e6cd5880" acquired by "delete_volume" :: waited 0.064s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:23:36 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4783bd28-6e5d-4c1b-8644-76fd4307f255]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:23:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a971f483-63ea-420b-96fa-2a97e6cd5880 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:23:37 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a971f483-63ea-420b-96fa-2a97e6cd5880 Sep 10 18:23:37 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:23:37 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Sep 10 18:23:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a971f483-63ea-420b-96fa-2a97e6cd5880" returned: 0 in 0.661s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:23:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a971f483-63ea-420b-96fa-2a97e6cd5880 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:23:37 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a971f483-63ea-420b-96fa-2a97e6cd5880 Sep 10 18:23:37 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:23:37 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Sep 10 18:23:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a971f483-63ea-420b-96fa-2a97e6cd5880" returned: 0 in 0.397s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:23:37 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] Lock "cinder-quobyte-a971f483-63ea-420b-96fa-2a97e6cd5880" released by "delete_volume" :: held 1.187s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:23:38 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] Created reservations ['bd343345-d3c4-415b-9d35-40963f498a63', '328e7da8-066f-4473-ab18-5f84ff0b992a', 'fe5353fc-2c58-4403-a18c-3909e24cad90', '45edae99-c154-4ee2-be2b-adb86571bfba'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:23:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:23:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:23:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:23:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:23:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:23:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:23:38 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:23:38 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:23:38 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Sep 10 18:23:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.371s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:23:38 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:23:38 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] Deleted volume successfully. Sep 10 18:23:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ea01c9df-04e4-43ec-9112-e85d711f2d5c tempest-VolumeQuotasNegativeTestJSON-410428612 None] Lock "cinder-a971f483-63ea-420b-96fa-2a97e6cd5880-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:23:41 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:23:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Flow 'volume_create_manager' (66717e02-64ef-49ab-95d8-c2f9b2ba108f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:23:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5bb803-74e2-4723-8e59-960feba221bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:23:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5bb803-74e2-4723-8e59-960feba221bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-769308736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587713b75a1746c1a0cb11271b20a363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:23:42Z,use_quota=True,user_id='09802de5bc7f41dc8013ffb6f1256507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:23:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893ca463-995a-4149-8ba7-29b03e8891fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:23:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893ca463-995a-4149-8ba7-29b03e8891fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:23:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f84da3a-e5f0-4594-8842-3929b946f9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:23:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f84da3a-e5f0-4594-8842-3929b946f9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506', 'volume_name': 'volume-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:23:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef6aea5-6bca-477b-868d-069d25f459e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:23:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef6aea5-6bca-477b-868d-069d25f459e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:23:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409a4fd1-13f0-4199-8fa5-f0ed7708b4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:23:41 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Volume 8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506', 'volume_size': 1} Sep 10 18:23:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:23:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:23:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-769308736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587713b75a1746c1a0cb11271b20a363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:23:42Z,use_quota=True,user_id='09802de5bc7f41dc8013ffb6f1256507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:23:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Creating volume 8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:23:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:23:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:23:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:23:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:23:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:23:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:23:42 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:23:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:23:42 devstack sudo[92883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506 1073741824 Sep 10 18:23:42 devstack sudo[92883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:23:42 devstack sudo[92883]: pam_unix(sudo:session): session closed for user root Sep 10 18:23:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506 1073741824" returned: 0 in 0.659s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:23:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:23:42 devstack sudo[92889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506 Sep 10 18:23:42 devstack sudo[92889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:23:43 devstack sudo[92889]: pam_unix(sudo:session): session closed for user root Sep 10 18:23:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506" returned: 0 in 0.476s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:23:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:23:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:23:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409a4fd1-13f0-4199-8fa5-f0ed7708b4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:23:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd071aa-3b97-45ac-add9-f2f9177b36fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:23:43 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Volume volume-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506 (8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506): created successfully Sep 10 18:23:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd071aa-3b97-45ac-add9-f2f9177b36fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:23:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Flow 'volume_create_manager' (66717e02-64ef-49ab-95d8-c2f9b2ba108f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:23:43 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d92f0708-1203-4b81-9a07-8308dd0b271e tempest-AttachVolumeNegativeTest-1370217353 None] Created volume successfully. Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Flow 'volume_create_manager' (d2154908-1573-4891-b453-1e7d26d7be3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6668b269-3072-4014-8989-4c1847f99ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6668b269-3072-4014-8989-4c1847f99ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-49670018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5745dc8-126a-4a97-91fe-a7e5b06a1ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58509e8dadf54d2b88c65795a3d555bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:23:45Z,use_quota=True,user_id='f97a3aa1dc8542218fcd415aab5fb720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c32104-6a93-4ebd-aa83-e2b40df4c978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c32104-6a93-4ebd-aa83-e2b40df4c978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5505605c-6414-433e-bb1f-c436cf55d153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5505605c-6414-433e-bb1f-c436cf55d153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5745dc8-126a-4a97-91fe-a7e5b06a1ebc', 'volume_name': 'volume-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab57972-607c-4b86-88ad-ae003055032d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab57972-607c-4b86-88ad-ae003055032d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea068ec-e685-4fb1-98a1-40defa08b727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:23:45 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Volume c5745dc8-126a-4a97-91fe-a7e5b06a1ebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc', 'volume_size': 1} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-49670018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5745dc8-126a-4a97-91fe-a7e5b06a1ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58509e8dadf54d2b88c65795a3d555bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:23:45Z,use_quota=True,user_id='f97a3aa1dc8542218fcd415aab5fb720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Creating volume c5745dc8-126a-4a97-91fe-a7e5b06a1ebc {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:23:45 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:23:45 devstack sudo[92909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc 1073741824 Sep 10 18:23:45 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:23:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-860b15b8-645b-46b5-88fc-7acff007f1db req-77f96e0c-28d4-4408-a065-444b1a77a752 tempest-AttachVolumeNegativeTest-1370217353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:23:47 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root Sep 10 18:23:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc 1073741824" returned: 0 in 1.360s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:23:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:23:47 devstack sudo[92940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc Sep 10 18:23:47 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:23:47 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root Sep 10 18:23:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc" returned: 0 in 0.648s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:23:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] <== create_volume: return (2148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:23:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:23:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-860b15b8-645b-46b5-88fc-7acff007f1db req-77f96e0c-28d4-4408-a065-444b1a77a752 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.053s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:23:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea068ec-e685-4fb1-98a1-40defa08b727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:23:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1616dd0-8cd2-4563-b58b-95739ed63bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:23:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-860b15b8-645b-46b5-88fc-7acff007f1db req-77f96e0c-28d4-4408-a065-444b1a77a752 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:23:47 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Volume volume-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc (c5745dc8-126a-4a97-91fe-a7e5b06a1ebc): created successfully Sep 10 18:23:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1616dd0-8cd2-4563-b58b-95739ed63bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:23:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Flow 'volume_create_manager' (d2154908-1573-4891-b453-1e7d26d7be3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:23:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-860b15b8-645b-46b5-88fc-7acff007f1db req-77f96e0c-28d4-4408-a065-444b1a77a752 tempest-AttachVolumeNegativeTest-1370217353 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed1c9a61-e39e-401d-b60a-b630ba3f3756', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:23:48 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c4341d5c-88c2-41aa-8d52-1b72f58dc858 tempest-ServerRescueNegativeTestJSON-1428052204 None] Created volume successfully. Sep 10 18:23:48 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-860b15b8-645b-46b5-88fc-7acff007f1db req-77f96e0c-28d4-4408-a065-444b1a77a752 tempest-AttachVolumeNegativeTest-1370217353 None] attachment_update completed successfully. Sep 10 18:23:49 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-96c9a95b-85a5-43e3-9d3d-676117adbe28 tempest-ServerActionsTestOtherA-1901608082 None] Terminate volume connection completed successfully. Sep 10 18:23:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-96c9a95b-85a5-43e3-9d3d-676117adbe28 tempest-ServerActionsTestOtherA-1901608082 None] Deleting attachment df219e87-b73c-466f-a0fe-cdbc99a74ddd. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:23:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] Acquiring lock "cinder-4462c8e0-ce75-46c5-91a3-0ea773b2a298-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:23:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] Lock "cinder-4462c8e0-ce75-46c5-91a3-0ea773b2a298-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:23:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] Acquiring lock "cinder-quobyte-4462c8e0-ce75-46c5-91a3-0ea773b2a298" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:23:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] Lock "cinder-quobyte-4462c8e0-ce75-46c5-91a3-0ea773b2a298" acquired by "delete_volume" :: waited 0.034s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:23:50 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd892320-6e87-4937-a69f-cf9d003f2676]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:23:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:23:50 devstack sudo[93337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298 Sep 10 18:23:50 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:23:51 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root Sep 10 18:23:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298" returned: 0 in 1.187s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:23:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:23:51 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298 Sep 10 18:23:51 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:23:51 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Sep 10 18:23:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4462c8e0-ce75-46c5-91a3-0ea773b2a298" returned: 0 in 0.371s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:23:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] Lock "cinder-quobyte-4462c8e0-ce75-46c5-91a3-0ea773b2a298" released by "delete_volume" :: held 1.692s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:23:52 devstack cinder-volume[87842]: DEBUG cinder.quota [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] Created reservations ['a7dbe60c-ed9b-497b-ba6f-20fd5259275f', '65a8b682-09ec-4797-a8be-ceb2c859a3ae', '4a7f74df-3eb9-40d2-a930-a15a9376dc07', '184b81b1-cb16-4115-b2b5-88f3d51af033'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:23:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:23:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:23:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:23:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:23:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:23:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:23:52 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:23:52 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:23:52 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] Acquiring lock "cinder-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:23:52 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] Lock "cinder-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:23:52 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] Acquiring lock "cinder-quobyte-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:23:52 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] Lock "cinder-quobyte-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5" acquired by "delete_volume" :: waited 0.039s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:23:52 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5d4bb6-197d-470c-a5fa-a99a6d32a282]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:23:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:23:52 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Sep 10 18:23:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.473s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:23:52 devstack cinder-volume[87842]: DEBUG cinder.manager [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:23:52 devstack sudo[93411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5 Sep 10 18:23:52 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] Deleted volume successfully. Sep 10 18:23:52 devstack sudo[93411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:23:52 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-001d5d23-5b98-4a4a-a7fd-82aaf34d5087 req-75829216-34cb-4ba5-bb6f-54c45ebde86c tempest-ServerActionsTestOtherA-1901608082 None] Lock "cinder-4462c8e0-ce75-46c5-91a3-0ea773b2a298-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:23:53 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-8ed472fe-005b-4abe-aa07-3def1b0f34ad req-68360e0b-6de3-4e7a-a0df-c8b4ad65ede5 tempest-AttachVolumeNegativeTest-1370217353 None] Terminate volume connection completed successfully. Sep 10 18:23:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-8ed472fe-005b-4abe-aa07-3def1b0f34ad req-68360e0b-6de3-4e7a-a0df-c8b4ad65ede5 tempest-AttachVolumeNegativeTest-1370217353 None] Deleting attachment ed1c9a61-e39e-401d-b60a-b630ba3f3756. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:23:53 devstack sudo[93411]: pam_unix(sudo:session): session closed for user root Sep 10 18:23:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5" returned: 0 in 0.880s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:23:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:23:53 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5 Sep 10 18:23:53 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:23:53 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Sep 10 18:23:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5" returned: 0 in 0.410s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:23:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] Lock "cinder-quobyte-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5" released by "delete_volume" :: held 1.390s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:23:53 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] Created reservations ['817cb661-c22b-4ff4-b23c-cebef490e4c7', '743a5477-3d9e-46e6-b663-ea9c08e0f42d', 'ddaa5e54-3aed-4493-b24b-4dce0c29f2ee', '008729a5-2ce3-4999-a3f2-c783b008eb9b'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:23:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:23:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:23:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:23:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:23:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:23:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:23:54 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:23:54 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:23:54 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Sep 10 18:23:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.322s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:23:54 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:23:54 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] Deleted volume successfully. Sep 10 18:23:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a16a8244-1b4e-4451-b7fa-6d7644f08a03 tempest-ServerActionsTestOtherA-1901608082 None] Lock "cinder-55d5f68b-d4d7-4bca-b9ff-d40f0d83aec5-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:24:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] Acquiring lock "cinder-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:24:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] Lock "cinder-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:24:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] Acquiring lock "cinder-quobyte-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:24:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] Lock "cinder-quobyte-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc" acquired by "delete_volume" :: waited 0.061s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:24:03 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12bfa83-6599-4282-bc3f-c36cba76a2ea]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:24:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:03 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc Sep 10 18:24:03 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:04 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc" returned: 0 in 0.564s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:04 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc Sep 10 18:24:04 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:04 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc" returned: 0 in 0.581s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] Lock "cinder-quobyte-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc" released by "delete_volume" :: held 1.242s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:24:04 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] Created reservations ['ffa29aad-87e1-4bdb-9eea-f946518223f9', '7797cbb0-2015-496f-9966-940ee3f76e0d', 'd8f05771-7aa1-469f-8882-f54e6b7a799a', 'f7085ea7-e2fe-401a-9606-ff1386d3667c'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Flow 'volume_create_manager' (042515f0-f88f-4132-bc87-bb256e724f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74bc536-10ad-4d84-9bce-91b7626dcccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74bc536-10ad-4d84-9bce-91b7626dcccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-83719799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f31ef81e-f058-424c-b501-9146be0c8adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5798d953589425bb40a05fd0688a57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:24:05Z,use_quota=True,user_id='c432f59342fc4941994781da1839d203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c119ae5-cf46-499a-8cc7-d7613d4f799e),volume_type_id=8c119ae5-cf46-499a-8cc7-d7613d4f799e)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b51121a-3133-40ac-a8c1-98d3d03d47c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b51121a-3133-40ac-a8c1-98d3d03d47c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42df2cb9-9a18-462e-81d8-f921e48a923c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42df2cb9-9a18-462e-81d8-f921e48a923c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f31ef81e-f058-424c-b501-9146be0c8adc', 'volume_name': 'volume-f31ef81e-f058-424c-b501-9146be0c8adc', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a237562c-9a9c-457c-86c8-69eb1fe2a32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a237562c-9a9c-457c-86c8-69eb1fe2a32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f63078-3196-478e-822c-ac4a32fcf62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:24:05 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Volume f31ef81e-f058-424c-b501-9146be0c8adc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f31ef81e-f058-424c-b501-9146be0c8adc', 'volume_size': 1} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-83719799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f31ef81e-f058-424c-b501-9146be0c8adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5798d953589425bb40a05fd0688a57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:24:05Z,use_quota=True,user_id='c432f59342fc4941994781da1839d203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c119ae5-cf46-499a-8cc7-d7613d4f799e),volume_type_id=8c119ae5-cf46-499a-8cc7-d7613d4f799e)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Creating volume f31ef81e-f058-424c-b501-9146be0c8adc {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:24:05 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f31ef81e-f058-424c-b501-9146be0c8adc 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:05 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f31ef81e-f058-424c-b501-9146be0c8adc 1073741824 Sep 10 18:24:05 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:05 devstack sudo[93605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:24:05 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:05 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.527s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:24:05 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] Deleted volume successfully. Sep 10 18:24:05 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-df6f290d-16fe-4d39-b25b-c393b8561281 tempest-ServerRescueNegativeTestJSON-1428052204 None] Lock "cinder-c5745dc8-126a-4a97-91fe-a7e5b06a1ebc-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:24:06 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f31ef81e-f058-424c-b501-9146be0c8adc 1073741824" returned: 0 in 0.976s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f31ef81e-f058-424c-b501-9146be0c8adc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:06 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f31ef81e-f058-424c-b501-9146be0c8adc Sep 10 18:24:06 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:06 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f31ef81e-f058-424c-b501-9146be0c8adc" returned: 0 in 0.572s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:06 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:24:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:24:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f63078-3196-478e-822c-ac4a32fcf62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f31ef81e-f058-424c-b501-9146be0c8adc', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:24:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcbb2f3b-4465-4339-930f-1d8d1613b4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:24:06 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Volume volume-f31ef81e-f058-424c-b501-9146be0c8adc (f31ef81e-f058-424c-b501-9146be0c8adc): created successfully Sep 10 18:24:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcbb2f3b-4465-4339-930f-1d8d1613b4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:24:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Flow 'volume_create_manager' (042515f0-f88f-4132-bc87-bb256e724f8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:24:07 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-42ee4b99-6e34-4286-975a-61b2fca8db2f tempest-VolumeTypesAccessTest-312744685 None] Created volume successfully. Sep 10 18:24:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] Acquiring lock "cinder-f31ef81e-f058-424c-b501-9146be0c8adc-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:24:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] Lock "cinder-f31ef81e-f058-424c-b501-9146be0c8adc-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:24:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] Acquiring lock "cinder-quobyte-f31ef81e-f058-424c-b501-9146be0c8adc" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:24:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] Lock "cinder-quobyte-f31ef81e-f058-424c-b501-9146be0c8adc" acquired by "delete_volume" :: waited 0.020s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:24:07 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2644d4-0038-446f-81ec-62a9064926ed]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:24:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f31ef81e-f058-424c-b501-9146be0c8adc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:07 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f31ef81e-f058-424c-b501-9146be0c8adc Sep 10 18:24:07 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:08 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f31ef81e-f058-424c-b501-9146be0c8adc" returned: 0 in 0.831s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f31ef81e-f058-424c-b501-9146be0c8adc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:08 devstack sudo[93663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f31ef81e-f058-424c-b501-9146be0c8adc Sep 10 18:24:08 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:08 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f31ef81e-f058-424c-b501-9146be0c8adc" returned: 0 in 0.309s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] Lock "cinder-quobyte-f31ef81e-f058-424c-b501-9146be0c8adc" released by "delete_volume" :: held 1.201s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:24:08 devstack cinder-volume[87842]: WARNING cinder.quota [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1928008623 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1928008623, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:24:08 devstack cinder-volume[87842]: WARNING cinder.quota [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1928008623 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1928008623, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:24:08 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] Created reservations ['ce3376f9-65fc-43f9-b3a2-b7913731aa8c', '592b970b-fd7d-437d-b10d-5f6102491f2e', '443dc8af-473c-42e7-ba4f-328012817d3f', 'fbcbe429-583c-49f5-b6af-8efabbcfa36b'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:24:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:24:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:24:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:24:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:24:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:24:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:08 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:24:08 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:09 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.339s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:09 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:24:09 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] Deleted volume successfully. Sep 10 18:24:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b78aa2db-0370-455c-aa7c-dea604e007b2 tempest-VolumeTypesAccessTest-312744685 None] Lock "cinder-f31ef81e-f058-424c-b501-9146be0c8adc-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:24:18 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:UPDATE=51,cinder:SELECT=39,cinder:INSERT=10,cinder:DELETE=5 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:24:19 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=44,cinder:INSERT=14,cinder:UPDATE=56,cinder:DELETE=4 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:24:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:24:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:24:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:24:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:24:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:24:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:24:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:29 devstack sudo[93827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:24:29 devstack sudo[93827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:29 devstack sudo[93827]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.421s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:24:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:24:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 28 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:24:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:24:38 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:24:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Flow 'volume_create_manager' (c14066b4-a71a-4cc8-ab13-10eb995da4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:24:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6032376-016f-4b37-97ec-7d534fd3de95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:24:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6032376-016f-4b37-97ec-7d534fd3de95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1051167682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fbe5b8-d822-4038-9154-6ad01e2b6097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57ff8207aa84fe3be39af643ce42fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:24:38Z,use_quota=True,user_id='018c15f9e3114df0a2046bc1b63a6a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:24:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ed2c40-a32c-4695-9f29-7d3f6366b90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:24:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ed2c40-a32c-4695-9f29-7d3f6366b90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:24:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314ce22b-801c-4c37-b40d-a3fd7f792f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:24:38 devstack cinder-volume[87842]: DEBUG cinder.image.glance [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Creating Keystone auth plugin from conf {{(pid=87842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 18:24:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314ce22b-801c-4c37-b40d-a3fd7f792f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '23fbe5b8-d822-4038-9154-6ad01e2b6097', 'volume_name': 'volume-23fbe5b8-d822-4038-9154-6ad01e2b6097', 'volume_size': 1, 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12fe9fd924464f1896748c45b7609239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'created_at': datetime.datetime(2026, 9, 10, 16, 14, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 14, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0312d110-0baa-405f-96b9-31d6f3adc458/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:24:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f35c1e-1875-42c4-8c35-0e2879d07e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:24:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f35c1e-1875-42c4-8c35-0e2879d07e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:24:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d912e9-edd5-4ad3-ab9b-3eb73c938671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:24:38 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Volume 23fbe5b8-d822-4038-9154-6ad01e2b6097: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-23fbe5b8-d822-4038-9154-6ad01e2b6097', 'volume_size': 1, 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12fe9fd924464f1896748c45b7609239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'created_at': datetime.datetime(2026, 9, 10, 16, 14, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 14, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0312d110-0baa-405f-96b9-31d6f3adc458/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 18:24:38 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Trying to clone 23fbe5b8-d822-4038-9154-6ad01e2b6097 from image 0312d110-0baa-405f-96b9-31d6f3adc458 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]). {{(pid=87842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 18:24:39 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_lzxb_9jbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 18:24:39 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Image download 20.69 MB at 20.69 MB/s Sep 10 18:24:39 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d21270-2539-456d-9d5c-c8be047f37cd]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:24:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_lzxb_9jbdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:39 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_lzxb_9jbdevstack@QuobyteHD Sep 10 18:24:39 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:39 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_lzxb_9jbdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:39 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Temporary image 0312d110-0baa-405f-96b9-31d6f3adc458 is fetched for user 018c15f9e3114df0a2046bc1b63a6a25. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 18:24:39 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[209173b1-1b98-46c5-805f-a85ff9d5dfcc]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:24:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_lzxb_9jbdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:39 devstack sudo[93860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_lzxb_9jbdevstack@QuobyteHD Sep 10 18:24:39 devstack sudo[93860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:40 devstack sudo[93860]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_lzxb_9jbdevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:24:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:24:40 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1051167682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fbe5b8-d822-4038-9154-6ad01e2b6097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57ff8207aa84fe3be39af643ce42fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:24:38Z,use_quota=True,user_id='018c15f9e3114df0a2046bc1b63a6a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:24:40 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Creating volume 23fbe5b8-d822-4038-9154-6ad01e2b6097 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:24:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:24:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:24:40 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:24:40 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:24:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:24:40 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:24:40 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:24:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23fbe5b8-d822-4038-9154-6ad01e2b6097 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:40 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23fbe5b8-d822-4038-9154-6ad01e2b6097 1073741824 Sep 10 18:24:40 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:40 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23fbe5b8-d822-4038-9154-6ad01e2b6097 1073741824" returned: 0 in 0.625s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23fbe5b8-d822-4038-9154-6ad01e2b6097 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:40 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23fbe5b8-d822-4038-9154-6ad01e2b6097 Sep 10 18:24:40 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:41 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23fbe5b8-d822-4038-9154-6ad01e2b6097" returned: 0 in 0.342s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:24:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:24:41 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Attempting download of 0312d110-0baa-405f-96b9-31d6f3adc458 ((None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}])) to volume 23fbe5b8-d822-4038-9154-6ad01e2b6097. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 18:24:41 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e378513e-78c0-4612-a42a-6bab98104e6a]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:24:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_g6q_jdw9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:41 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_g6q_jdw9 Sep 10 18:24:41 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:41 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_g6q_jdw9" returned: 0 in 0.352s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_g6q_jdw9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:41 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_g6q_jdw9 Sep 10 18:24:41 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:42 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_g6q_jdw9" returned: 1 in 0.478s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_g6q_jdw9' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:24:42 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[462686b5-f57a-4e7a-bc14-5802060eb719]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:24:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_lzxb_9jbdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:42 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_lzxb_9jbdevstack@QuobyteHD Sep 10 18:24:42 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:42 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_lzxb_9jbdevstack@QuobyteHD" returned: 0 in 0.682s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:42 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] 0312d110-0baa-405f-96b9-31d6f3adc458 was qcow2, converting to qcow2 {{(pid=87842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 18:24:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_lzxb_9jbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23fbe5b8-d822-4038-9154-6ad01e2b6097 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:42 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_lzxb_9jbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23fbe5b8-d822-4038-9154-6ad01e2b6097 Sep 10 18:24:42 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Flow 'volume_create_manager' (e465bc8a-ac90-4296-a8bc-c0b37710f1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50e68ab-1ab6-461e-8895-38010cf9f570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50e68ab-1ab6-461e-8895-38010cf9f570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-162945928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d04c50-bbcf-43ff-bd6e-45aecd2339de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587713b75a1746c1a0cb11271b20a363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:24:44Z,use_quota=True,user_id='09802de5bc7f41dc8013ffb6f1256507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b7a536-916c-4a57-9b7b-41cf4aede9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b7a536-916c-4a57-9b7b-41cf4aede9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2f6cb3-54fc-4c95-900a-1581e4105c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2f6cb3-54fc-4c95-900a-1581e4105c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2d04c50-bbcf-43ff-bd6e-45aecd2339de', 'volume_name': 'volume-c2d04c50-bbcf-43ff-bd6e-45aecd2339de', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfbeeac-9e93-4673-93d3-a055ac737e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfbeeac-9e93-4673-93d3-a055ac737e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6573ed-03e3-440f-bf98-ccbab42177d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:24:44 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Volume c2d04c50-bbcf-43ff-bd6e-45aecd2339de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2d04c50-bbcf-43ff-bd6e-45aecd2339de', 'volume_size': 1} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-162945928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d04c50-bbcf-43ff-bd6e-45aecd2339de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587713b75a1746c1a0cb11271b20a363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:24:44Z,use_quota=True,user_id='09802de5bc7f41dc8013ffb6f1256507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Creating volume c2d04c50-bbcf-43ff-bd6e-45aecd2339de {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:24:44 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2d04c50-bbcf-43ff-bd6e-45aecd2339de 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:44 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2d04c50-bbcf-43ff-bd6e-45aecd2339de 1073741824 Sep 10 18:24:44 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:44 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2d04c50-bbcf-43ff-bd6e-45aecd2339de 1073741824" returned: 0 in 0.627s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2d04c50-bbcf-43ff-bd6e-45aecd2339de {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:45 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2d04c50-bbcf-43ff-bd6e-45aecd2339de Sep 10 18:24:45 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:45 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2d04c50-bbcf-43ff-bd6e-45aecd2339de" returned: 0 in 0.384s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:24:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:24:45 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6573ed-03e3-440f-bf98-ccbab42177d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2d04c50-bbcf-43ff-bd6e-45aecd2339de', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:24:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75e0add-fa1e-4e89-8f50-6c7c15008f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:24:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_lzxb_9jbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23fbe5b8-d822-4038-9154-6ad01e2b6097" returned: 0 in 2.488s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:45 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_lzxb_9jbdevstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23fbe5b8-d822-4038-9154-6ad01e2b6097 {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:24:45 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Converted 112.00 MB image at 44.99 MB/s Sep 10 18:24:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23fbe5b8-d822-4038-9154-6ad01e2b6097 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:45 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Volume volume-c2d04c50-bbcf-43ff-bd6e-45aecd2339de (c2d04c50-bbcf-43ff-bd6e-45aecd2339de): created successfully Sep 10 18:24:45 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23fbe5b8-d822-4038-9154-6ad01e2b6097 1G Sep 10 18:24:45 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75e0add-fa1e-4e89-8f50-6c7c15008f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:24:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Flow 'volume_create_manager' (e465bc8a-ac90-4296-a8bc-c0b37710f1d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:24:45 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-fbdd5e48-5c9d-4b4a-ad41-1d324afaba67 tempest-AttachVolumeNegativeTest-1370217353 None] Created volume successfully. Sep 10 18:24:46 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23fbe5b8-d822-4038-9154-6ad01e2b6097 1G" returned: 0 in 0.658s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:46 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Downloaded image 0312d110-0baa-405f-96b9-31d6f3adc458 ((None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}])) to volume 23fbe5b8-d822-4038-9154-6ad01e2b6097 successfully. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 18:24:46 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Temporary image 0312d110-0baa-405f-96b9-31d6f3adc458 for user 018c15f9e3114df0a2046bc1b63a6a25 is deleted. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 18:24:46 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Marking volume 23fbe5b8-d822-4038-9154-6ad01e2b6097 as bootable. {{(pid=87842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 18:24:46 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Copying metadata from image 0312d110-0baa-405f-96b9-31d6f3adc458 to 23fbe5b8-d822-4038-9154-6ad01e2b6097. {{(pid=87842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 18:24:46 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Creating volume glance metadata for volume 23fbe5b8-d822-4038-9154-6ad01e2b6097 backed by image 0312d110-0baa-405f-96b9-31d6f3adc458 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 18:24:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d912e9-edd5-4ad3-ab9b-3eb73c938671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23fbe5b8-d822-4038-9154-6ad01e2b6097', 'volume_size': 1, 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12fe9fd924464f1896748c45b7609239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'created_at': datetime.datetime(2026, 9, 10, 16, 14, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 14, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0312d110-0baa-405f-96b9-31d6f3adc458/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:24:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcc516a-27eb-451a-ba3b-472e8516bfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:24:46 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Volume volume-23fbe5b8-d822-4038-9154-6ad01e2b6097 (23fbe5b8-d822-4038-9154-6ad01e2b6097): created successfully Sep 10 18:24:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcc516a-27eb-451a-ba3b-472e8516bfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:24:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Flow 'volume_create_manager' (c14066b4-a71a-4cc8-ab13-10eb995da4e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:24:46 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f020c643-9ce3-41a4-a850-5d351736cf0d tempest-VolumesImageMetadata-1375002324 None] Created volume successfully. Sep 10 18:24:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-27d4ffa3-6dae-4af4-b075-1a73cd330a8f req-5660274d-576c-4295-ad85-7d5ad10133c1 tempest-AttachVolumeNegativeTest-1370217353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:24:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-27d4ffa3-6dae-4af4-b075-1a73cd330a8f req-5660274d-576c-4295-ad85-7d5ad10133c1 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:24:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-27d4ffa3-6dae-4af4-b075-1a73cd330a8f req-5660274d-576c-4295-ad85-7d5ad10133c1 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:24:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-27d4ffa3-6dae-4af4-b075-1a73cd330a8f req-5660274d-576c-4295-ad85-7d5ad10133c1 tempest-AttachVolumeNegativeTest-1370217353 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-c2d04c50-bbcf-43ff-bd6e-45aecd2339de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3740e1ef-601a-4f8c-ae79-2613a628a351', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:24:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] Acquiring lock "cinder-23fbe5b8-d822-4038-9154-6ad01e2b6097-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:24:48 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-27d4ffa3-6dae-4af4-b075-1a73cd330a8f req-5660274d-576c-4295-ad85-7d5ad10133c1 tempest-AttachVolumeNegativeTest-1370217353 None] attachment_update completed successfully. Sep 10 18:24:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] Lock "cinder-23fbe5b8-d822-4038-9154-6ad01e2b6097-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:24:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] Acquiring lock "cinder-quobyte-23fbe5b8-d822-4038-9154-6ad01e2b6097" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:24:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] Lock "cinder-quobyte-23fbe5b8-d822-4038-9154-6ad01e2b6097" acquired by "delete_volume" :: waited 0.033s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:24:49 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5be8af9-8f90-4aeb-bd58-cc2feed2d740]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:24:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23fbe5b8-d822-4038-9154-6ad01e2b6097 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:49 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23fbe5b8-d822-4038-9154-6ad01e2b6097 Sep 10 18:24:49 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:50 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23fbe5b8-d822-4038-9154-6ad01e2b6097" returned: 0 in 0.732s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23fbe5b8-d822-4038-9154-6ad01e2b6097 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:50 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23fbe5b8-d822-4038-9154-6ad01e2b6097 Sep 10 18:24:50 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:50 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23fbe5b8-d822-4038-9154-6ad01e2b6097" returned: 0 in 0.627s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] Lock "cinder-quobyte-23fbe5b8-d822-4038-9154-6ad01e2b6097" released by "delete_volume" :: held 1.487s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:24:50 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] Created reservations ['84cb828f-a3c1-43fe-ac14-40c4af994a3a', '066eb0c9-8a5f-41de-8391-1a32a2e15369', '20f730fe-1307-43d4-a544-86cde939528c', '90378fef-8811-4973-8309-3a50f153bf12'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:24:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:24:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:24:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:24:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:24:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:24:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:24:51 devstack sudo[94491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:24:51 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:24:51 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root Sep 10 18:24:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.457s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:24:51 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:24:51 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] Deleted volume successfully. Sep 10 18:24:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6d25f882-2b3a-446e-bdb1-2c949b719fd7 tempest-VolumesImageMetadata-1375002324 None] Lock "cinder-23fbe5b8-d822-4038-9154-6ad01e2b6097-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:24:52 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-8b981fbd-68b3-4029-a7ef-f5306a2578ff req-fe6b03e7-4cc5-4ef1-a478-9d7375e524be tempest-AttachVolumeNegativeTest-1370217353 None] Terminate volume connection completed successfully. Sep 10 18:24:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-8b981fbd-68b3-4029-a7ef-f5306a2578ff req-fe6b03e7-4cc5-4ef1-a478-9d7375e524be tempest-AttachVolumeNegativeTest-1370217353 None] Deleting attachment 3740e1ef-601a-4f8c-ae79-2613a628a351. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Flow 'volume_create_manager' (1325a4f2-4d7e-4740-abfb-2127ab9f3cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd22380-304b-4a6c-8ffe-ef57a13856ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd22380-304b-4a6c-8ffe-ef57a13856ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-904634928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b13dbf-553f-4886-8703-d7e102e2895f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50213c4f3a8344d0a0957acda6ac96e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:25:01Z,use_quota=True,user_id='bc13a217c697465c8269652c8f248739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071fe8b9-4cdf-46ef-994f-d8e9ff8cadf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071fe8b9-4cdf-46ef-994f-d8e9ff8cadf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba4d36f-277b-4e9a-8f94-8dff41426b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba4d36f-277b-4e9a-8f94-8dff41426b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98b13dbf-553f-4886-8703-d7e102e2895f', 'volume_name': 'volume-98b13dbf-553f-4886-8703-d7e102e2895f', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88728633-44d9-4dcf-a8d4-b7eb2752d60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88728633-44d9-4dcf-a8d4-b7eb2752d60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb4646a-e2b8-46e0-b121-a68f8ef012c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:01 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Volume 98b13dbf-553f-4886-8703-d7e102e2895f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98b13dbf-553f-4886-8703-d7e102e2895f', 'volume_size': 1} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-904634928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b13dbf-553f-4886-8703-d7e102e2895f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50213c4f3a8344d0a0957acda6ac96e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:25:01Z,use_quota=True,user_id='bc13a217c697465c8269652c8f248739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Creating volume 98b13dbf-553f-4886-8703-d7e102e2895f {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:25:01 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:25:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:01 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f 1073741824 Sep 10 18:25:01 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:02 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f 1073741824" returned: 0 in 1.148s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:02 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f Sep 10 18:25:02 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:03 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f" returned: 0 in 0.706s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:25:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb4646a-e2b8-46e0-b121-a68f8ef012c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b13dbf-553f-4886-8703-d7e102e2895f', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821b6064-d274-4bd1-b04a-28f0df51a128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:03 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Volume volume-98b13dbf-553f-4886-8703-d7e102e2895f (98b13dbf-553f-4886-8703-d7e102e2895f): created successfully Sep 10 18:25:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821b6064-d274-4bd1-b04a-28f0df51a128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Flow 'volume_create_manager' (1325a4f2-4d7e-4740-abfb-2127ab9f3cdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:25:03 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-a38a2be1-8e8c-44a2-971a-65d04ca157b4 tempest-VolumesCloneTest-1410361681 None] Created volume successfully. Sep 10 18:25:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] Acquiring lock "cinder-c2d04c50-bbcf-43ff-bd6e-45aecd2339de-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "cinder-c2d04c50-bbcf-43ff-bd6e-45aecd2339de-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] Acquiring lock "cinder-quobyte-c2d04c50-bbcf-43ff-bd6e-45aecd2339de" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "cinder-quobyte-c2d04c50-bbcf-43ff-bd6e-45aecd2339de" acquired by "delete_volume" :: waited 0.054s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:03 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[39317a21-050f-4da5-b1c0-fbb8d6c2e58a]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2d04c50-bbcf-43ff-bd6e-45aecd2339de {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:03 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2d04c50-bbcf-43ff-bd6e-45aecd2339de Sep 10 18:25:03 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:04 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2d04c50-bbcf-43ff-bd6e-45aecd2339de" returned: 0 in 0.726s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2d04c50-bbcf-43ff-bd6e-45aecd2339de {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:04 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2d04c50-bbcf-43ff-bd6e-45aecd2339de Sep 10 18:25:04 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:05 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2d04c50-bbcf-43ff-bd6e-45aecd2339de" returned: 0 in 0.508s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "cinder-quobyte-c2d04c50-bbcf-43ff-bd6e-45aecd2339de" released by "delete_volume" :: held 1.326s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] Created reservations ['a4e4815b-b2b0-4775-a299-ed701cb7759c', '44873d78-4c23-4963-a11a-b7fbfd5e1c84', 'fe8f4fa1-e2e9-4b36-9671-b2db33983127', 'd340ab0d-646d-4885-a067-fc9975d80040'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:05 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:25:05 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:25:05 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Flow 'volume_create_manager' (ef65a5c6-5544-470d-980e-5915169fdf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879d050a-f03c-4791-b253-4a38d49e3abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.513s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:25:05 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] Deleted volume successfully. Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879d050a-f03c-4791-b253-4a38d49e3abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1285178101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd7208b-e8f3-4455-8b4a-48122371e2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50213c4f3a8344d0a0957acda6ac96e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:25:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=98b13dbf-553f-4886-8703-d7e102e2895f,status='creating',terminated_at=None,updated_at=2026-09-10T16:25:05Z,use_quota=True,user_id='bc13a217c697465c8269652c8f248739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad73677a-bfad-4a22-8682-e84d0d055ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad73677a-bfad-4a22-8682-e84d0d055ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bcb69f8-b706-465d-a3d5-a4165917c13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bcb69f8-b706-465d-a3d5-a4165917c13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ccd7208b-e8f3-4455-8b4a-48122371e2ea', 'volume_name': 'volume-ccd7208b-e8f3-4455-8b4a-48122371e2ea', 'volume_size': 2, 'source_volid': '98b13dbf-553f-4886-8703-d7e102e2895f', 'source_volstatus': 'available'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f412275-e86d-46af-8144-bff0ace7d080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f412275-e86d-46af-8144-bff0ace7d080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6524c1-8f9a-4a8a-9102-e998cb4cd075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:06 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Volume ccd7208b-e8f3-4455-8b4a-48122371e2ea: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ccd7208b-e8f3-4455-8b4a-48122371e2ea', 'volume_size': 2, 'source_volid': '98b13dbf-553f-4886-8703-d7e102e2895f', 'source_volstatus': 'available'} Sep 10 18:25:06 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-72e96a44-f120-4c83-aa1f-c6507d92cd37 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "cinder-c2d04c50-bbcf-43ff-bd6e-45aecd2339de-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:06 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Cloning volume 98b13dbf-553f-4886-8703-d7e102e2895f to volume ccd7208b-e8f3-4455-8b4a-48122371e2ea Sep 10 18:25:06 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Creating offline snapshot 35242a66-d79a-49ea-a503-a0ce6a336376 of volume 98b13dbf-553f-4886-8703-d7e102e2895f {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:25:06 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[924f6906-f024-4348-ab24-ce5d018dd9ce]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:06 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] Acquiring lock "cinder-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:06 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f Sep 10 18:25:06 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:06 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "cinder-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:06 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] Acquiring lock "cinder-quobyte-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:06 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "cinder-quobyte-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506" acquired by "delete_volume" :: waited 0.017s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:06 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c41030-05d1-4efd-bdb0-5307ee9b11fe]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:06 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506 Sep 10 18:25:06 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:06 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f" returned: 0 in 0.634s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:06 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376 1G Sep 10 18:25:06 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:07 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506" returned: 0 in 0.576s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:07 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506 Sep 10 18:25:07 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:07 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376 1G" returned: 0 in 0.710s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98b13dbf-553f-4886-8703-d7e102e2895f -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:07 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98b13dbf-553f-4886-8703-d7e102e2895f -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376 Sep 10 18:25:07 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:07 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506" returned: 0 in 0.475s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "cinder-quobyte-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506" released by "delete_volume" :: held 1.135s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:07 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] Created reservations ['9f226e0f-0e35-4471-853e-57551a52a2b8', 'e0039528-2d51-4fd3-b2ab-358de1723ec7', 'fd4da072-9a60-4f85-97a8-65de87f3cc4f', '6ec3c226-3d2b-451f-91e1-0c056fda9a5d'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:25:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:07 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:07 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:07 devstack sudo[95111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:25:07 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:07 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98b13dbf-553f-4886-8703-d7e102e2895f -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376" returned: 0 in 0.381s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:07 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376 is being set with open permissions: ugo+rw Sep 10 18:25:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:07 devstack sudo[95119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376 Sep 10 18:25:07 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:08 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.268s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:08 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:25:08 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] Deleted volume successfully. Sep 10 18:25:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f7d11908-14d8-4576-b116-dbbc5cf97742 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "cinder-8bdef8f8-686c-4abe-8ba7-ebf0b2ba3506-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:08 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376" returned: 0 in 0.263s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:08 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.info Sep 10 18:25:08 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:08 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.info" returned: 0 in 0.323s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:08 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.info is being set with open permissions: ugo+rw Sep 10 18:25:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:08 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.info Sep 10 18:25:08 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:08 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.info" returned: 0 in 0.385s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Acquiring lock "cinder-quobyte-ccd7208b-e8f3-4455-8b4a-48122371e2ea" by "_copy_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Lock "cinder-quobyte-ccd7208b-e8f3-4455-8b4a-48122371e2ea" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] snapshot: 35242a66-d79a-49ea-a503-a0ce6a336376, volume: ccd7208b-e8f3-4455-8b4a-48122371e2ea, {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] Acquiring lock "cinder-3c8c40eb-b69c-4f00-80dc-a3e713c1f688-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8151ee08-7bf3-46d1-896b-204665ade935]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "cinder-3c8c40eb-b69c-4f00-80dc-a3e713c1f688-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] Acquiring lock "cinder-quobyte-3c8c40eb-b69c-4f00-80dc-a3e713c1f688" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "cinder-quobyte-3c8c40eb-b69c-4f00-80dc-a3e713c1f688" acquired by "delete_volume" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd05b882-d790-4033-b63a-96ed32c4b8a2]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c8c40eb-b69c-4f00-80dc-a3e713c1f688 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:09 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376 Sep 10 18:25:09 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:09 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c8c40eb-b69c-4f00-80dc-a3e713c1f688 Sep 10 18:25:09 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:09 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376" returned: 0 in 0.449s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98b13dbf-553f-4886-8703-d7e102e2895f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[428dd389-6dfd-4a4c-8a96-c68cf5ccc6a0]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:09 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c8c40eb-b69c-4f00-80dc-a3e713c1f688" returned: 0 in 0.439s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c8c40eb-b69c-4f00-80dc-a3e713c1f688 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:09 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f Sep 10 18:25:09 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:09 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c8c40eb-b69c-4f00-80dc-a3e713c1f688 Sep 10 18:25:09 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:09 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c8c40eb-b69c-4f00-80dc-a3e713c1f688" returned: 0 in 0.280s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "cinder-quobyte-3c8c40eb-b69c-4f00-80dc-a3e713c1f688" released by "delete_volume" :: held 0.777s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:09 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f" returned: 0 in 0.459s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Creating direct copy from snapshot {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG cinder.utils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Path /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ccd7208b-e8f3-4455-8b4a-48122371e2ea not found in is_blk_device check {{(pid=87842) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 18:25:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ccd7208b-e8f3-4455-8b4a-48122371e2ea {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:10 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ccd7208b-e8f3-4455-8b4a-48122371e2ea Sep 10 18:25:10 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] Created reservations ['24fecd27-f381-4d3e-938e-3be7f8828dc9', 'e47856eb-58f5-491f-a35d-a1e3a010dfca', 'ee61dcba-b8a7-4685-83ae-2ea02a346622', 'a4e6e9e5-28e7-4e11-830a-394afbe2f4c7'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:10 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:25:10 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Flow 'volume_create_manager' (b65822bc-120f-4ae0-9cdf-ad06e42856aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f18c701-966e-4d7b-b485-73aa18623912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f18c701-966e-4d7b-b485-73aa18623912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-10437859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadd6abf-9ff0-41b3-8ef0-825e280fff04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea8b4b1f9b4459f8a7b8680c8081d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:25:10Z,use_quota=True,user_id='be03288230444a14b6edc36763c38526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb9a52c-f2c7-4945-9c14-598470efb19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:10 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb9a52c-f2c7-4945-9c14-598470efb19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e91ea32-4478-4ab9-9110-5750906975be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e91ea32-4478-4ab9-9110-5750906975be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aadd6abf-9ff0-41b3-8ef0-825e280fff04', 'volume_name': 'volume-aadd6abf-9ff0-41b3-8ef0-825e280fff04', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432923b5-8386-432d-ac8c-78d338800d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432923b5-8386-432d-ac8c-78d338800d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0eaa8b-c2c7-4f7a-9d89-b51e0921c940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:10 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Volume aadd6abf-9ff0-41b3-8ef0-825e280fff04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aadd6abf-9ff0-41b3-8ef0-825e280fff04', 'volume_size': 1} Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.402s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:25:10 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] Deleted volume successfully. Sep 10 18:25:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a397e622-3039-48f4-b733-9236911f7746 tempest-AttachVolumeNegativeTest-1370217353 None] Lock "cinder-3c8c40eb-b69c-4f00-80dc-a3e713c1f688-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:15 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ccd7208b-e8f3-4455-8b4a-48122371e2ea" returned: 0 in 5.547s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:15 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Image conversion details: src /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ccd7208b-e8f3-4455-8b4a-48122371e2ea {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:25:15 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Converted 1024.00 MB image at 184.57 MB/s Sep 10 18:25:15 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ccd7208b-e8f3-4455-8b4a-48122371e2ea is being set with open permissions: ugo+rw Sep 10 18:25:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ccd7208b-e8f3-4455-8b4a-48122371e2ea {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:15 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ccd7208b-e8f3-4455-8b4a-48122371e2ea Sep 10 18:25:15 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:15 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ccd7208b-e8f3-4455-8b4a-48122371e2ea" returned: 0 in 0.287s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:15 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Lock "cinder-quobyte-ccd7208b-e8f3-4455-8b4a-48122371e2ea" released by "_copy_volume_from_snapshot" :: held 6.850s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:15 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Acquiring lock "cinder-quobyte-35242a66-d79a-49ea-a503-a0ce6a336376" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:15 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Lock "cinder-quobyte-35242a66-d79a-49ea-a503-a0ce6a336376" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Deleting offline snapshot 35242a66-d79a-49ea-a503-a0ce6a336376 of volume 98b13dbf-553f-4886-8703-d7e102e2895f {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:25:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] snapshot_file for this snap is: volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:25:15 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbbe3a4-7410-4327-8ce6-4b5ee47aec23]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:16 devstack sudo[95177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376 Sep 10 18:25:16 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:16 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376" returned: 0 in 0.368s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98b13dbf-553f-4886-8703-d7e102e2895f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:25:16 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9f00ee-acd2-4100-a4eb-7617836053da]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:16 devstack sudo[95182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f Sep 10 18:25:16 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:16 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:25:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Flow 'volume_create_manager' (5b95f148-1f29-43a0-a76c-2e2408c731aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:25:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51111753-2c7a-4102-86e4-2145d282acdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51111753-2c7a-4102-86e4-2145d282acdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-939623835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3fb1602-8e39-4ca7-896b-5603e5691aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213c7d02b1c641bc991d3dc3b528c5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:25:16Z,use_quota=True,user_id='37b0ea1842d54a1cb59f53a910a642b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc336fbe-4c8a-4008-b703-e2edf266fa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc336fbe-4c8a-4008-b703-e2edf266fa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771988eb-ab05-4f74-b88d-b21d9a90b833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771988eb-ab05-4f74-b88d-b21d9a90b833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3fb1602-8e39-4ca7-896b-5603e5691aab', 'volume_name': 'volume-c3fb1602-8e39-4ca7-896b-5603e5691aab', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad007a20-99cf-47e9-a626-a744f0d11c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad007a20-99cf-47e9-a626-a744f0d11c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b245da-a414-4ccd-a34c-c15bc24b31b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:16 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Volume c3fb1602-8e39-4ca7-896b-5603e5691aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3fb1602-8e39-4ca7-896b-5603e5691aab', 'volume_size': 1} Sep 10 18:25:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:16 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f" returned: 0 in 0.578s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:16 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376 Sep 10 18:25:16 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:17 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376" returned: 0 in 0.338s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:17 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376 Sep 10 18:25:17 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:17 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f.35242a66-d79a-49ea-a503-a0ce6a336376" returned: 0 in 0.279s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Lock "cinder-quobyte-35242a66-d79a-49ea-a503-a0ce6a336376" released by "_delete_snapshot" :: held 1.660s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.516s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.017s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-10437859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadd6abf-9ff0-41b3-8ef0-825e280fff04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea8b4b1f9b4459f8a7b8680c8081d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:25:10Z,use_quota=True,user_id='be03288230444a14b6edc36763c38526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:25:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Creating volume aadd6abf-9ff0-41b3-8ef0-825e280fff04 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:25:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:25:17 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:25:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aadd6abf-9ff0-41b3-8ef0-825e280fff04 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6524c1-8f9a-4a8a-9102-e998cb4cd075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccd7208b-e8f3-4455-8b4a-48122371e2ea', 'volume_size': 2, 'source_volid': '98b13dbf-553f-4886-8703-d7e102e2895f', 'source_volstatus': 'available'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:17 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aadd6abf-9ff0-41b3-8ef0-825e280fff04 1073741824 Sep 10 18:25:17 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5580e4-8ce9-41d1-a792-7aa1c866138d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:17 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Volume volume-ccd7208b-e8f3-4455-8b4a-48122371e2ea (ccd7208b-e8f3-4455-8b4a-48122371e2ea): created successfully Sep 10 18:25:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5580e4-8ce9-41d1-a792-7aa1c866138d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Flow 'volume_create_manager' (ef65a5c6-5544-470d-980e-5915169fdf44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:25:17 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f47ed3ef-3baa-434f-be1d-5e711988e6f4 tempest-VolumesCloneTest-1410361681 None] Created volume successfully. Sep 10 18:25:18 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aadd6abf-9ff0-41b3-8ef0-825e280fff04 1073741824" returned: 0 in 0.474s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aadd6abf-9ff0-41b3-8ef0-825e280fff04 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:18 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aadd6abf-9ff0-41b3-8ef0-825e280fff04 Sep 10 18:25:18 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:18 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aadd6abf-9ff0-41b3-8ef0-825e280fff04" returned: 0 in 0.249s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.776s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-939623835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3fb1602-8e39-4ca7-896b-5603e5691aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213c7d02b1c641bc991d3dc3b528c5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:25:16Z,use_quota=True,user_id='37b0ea1842d54a1cb59f53a910a642b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Creating volume c3fb1602-8e39-4ca7-896b-5603e5691aab {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:25:18 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3fb1602-8e39-4ca7-896b-5603e5691aab 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0eaa8b-c2c7-4f7a-9d89-b51e0921c940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aadd6abf-9ff0-41b3-8ef0-825e280fff04', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434294a0-307f-4768-9d02-c339fff84d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:18 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3fb1602-8e39-4ca7-896b-5603e5691aab 1073741824 Sep 10 18:25:18 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:18 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Volume volume-aadd6abf-9ff0-41b3-8ef0-825e280fff04 (aadd6abf-9ff0-41b3-8ef0-825e280fff04): created successfully Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434294a0-307f-4768-9d02-c339fff84d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Flow 'volume_create_manager' (b65822bc-120f-4ae0-9cdf-ad06e42856aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:25:18 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e5e4d571-5f10-42e5-95e0-87517a4ffff9 tempest-ServersNegativeTestJSON-795997211 None] Created volume successfully. Sep 10 18:25:18 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3fb1602-8e39-4ca7-896b-5603e5691aab 1073741824" returned: 0 in 0.479s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3fb1602-8e39-4ca7-896b-5603e5691aab {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:18 devstack sudo[95211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3fb1602-8e39-4ca7-896b-5603e5691aab Sep 10 18:25:18 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:19 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3fb1602-8e39-4ca7-896b-5603e5691aab" returned: 0 in 0.298s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:25:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b245da-a414-4ccd-a34c-c15bc24b31b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3fb1602-8e39-4ca7-896b-5603e5691aab', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9e274e-3798-44c8-9431-625af6a3c5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:19 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Volume volume-c3fb1602-8e39-4ca7-896b-5603e5691aab (c3fb1602-8e39-4ca7-896b-5603e5691aab): created successfully Sep 10 18:25:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9e274e-3798-44c8-9431-625af6a3c5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Flow 'volume_create_manager' (5b95f148-1f29-43a0-a76c-2e2408c731aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:25:19 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-a75cb2d7-63e2-486d-a483-8b3581dcc3f0 tempest-AttachVolumeTestJSON-1356128937 None] Created volume successfully. Sep 10 18:25:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] Acquiring lock "cinder-ccd7208b-e8f3-4455-8b4a-48122371e2ea-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] Lock "cinder-ccd7208b-e8f3-4455-8b4a-48122371e2ea-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] Acquiring lock "cinder-quobyte-ccd7208b-e8f3-4455-8b4a-48122371e2ea" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] Lock "cinder-quobyte-ccd7208b-e8f3-4455-8b4a-48122371e2ea" acquired by "delete_volume" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:19 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5abea8-56cf-48eb-975e-056a1e14bf8c]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ccd7208b-e8f3-4455-8b4a-48122371e2ea {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:19 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ccd7208b-e8f3-4455-8b4a-48122371e2ea Sep 10 18:25:19 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:19 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ccd7208b-e8f3-4455-8b4a-48122371e2ea" returned: 0 in 0.474s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ccd7208b-e8f3-4455-8b4a-48122371e2ea {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:20 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ccd7208b-e8f3-4455-8b4a-48122371e2ea Sep 10 18:25:20 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:20 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ccd7208b-e8f3-4455-8b4a-48122371e2ea" returned: 0 in 0.281s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] Lock "cinder-quobyte-ccd7208b-e8f3-4455-8b4a-48122371e2ea" released by "delete_volume" :: held 0.807s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:20 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] Created reservations ['ec34da95-b87e-4d64-80b0-a866525ac5bd', '0e02f511-a724-4bf1-be9e-0b2964d1635e', 'f58fa597-4f78-4541-a2ef-5211eff351cf', '3023945f-964a-42b7-83e3-ae9ebb594934'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:25:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:20 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:25:20 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:20 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.363s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:20 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:25:20 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] Deleted volume successfully. Sep 10 18:25:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3e4e6a02-a6b0-479f-9ed6-97323fd57495 tempest-VolumesCloneTest-1410361681 None] Lock "cinder-ccd7208b-e8f3-4455-8b4a-48122371e2ea-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:20 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:25:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Flow 'volume_create_manager' (4340621a-00d1-49c4-824d-3091ca91e64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:25:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633c0c8f-0579-4414-a3bf-69fedb9be9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] Acquiring lock "cinder-98b13dbf-553f-4886-8703-d7e102e2895f-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633c0c8f-0579-4414-a3bf-69fedb9be9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2136564678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ae7066-19ca-498d-bd58-7181495c634c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea8b4b1f9b4459f8a7b8680c8081d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:25:21Z,use_quota=True,user_id='be03288230444a14b6edc36763c38526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f161be-28c5-4e97-8e7f-1a06d3c5762c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f161be-28c5-4e97-8e7f-1a06d3c5762c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ed2fa3-c389-488e-acaf-768d7c05b527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ed2fa3-c389-488e-acaf-768d7c05b527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ae7066-19ca-498d-bd58-7181495c634c', 'volume_name': 'volume-73ae7066-19ca-498d-bd58-7181495c634c', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6030f4f-6b1e-4ec3-ac1e-ea2bfb76dabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6030f4f-6b1e-4ec3-ac1e-ea2bfb76dabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f99f18ff-15a0-48f9-9fd5-2eed2a4cb0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:21 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Volume 73ae7066-19ca-498d-bd58-7181495c634c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ae7066-19ca-498d-bd58-7181495c634c', 'volume_size': 1} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2136564678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ae7066-19ca-498d-bd58-7181495c634c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea8b4b1f9b4459f8a7b8680c8081d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:25:21Z,use_quota=True,user_id='be03288230444a14b6edc36763c38526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Creating volume 73ae7066-19ca-498d-bd58-7181495c634c {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:25:21 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-73ae7066-19ca-498d-bd58-7181495c634c 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] Lock "cinder-98b13dbf-553f-4886-8703-d7e102e2895f-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:21 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-73ae7066-19ca-498d-bd58-7181495c634c 1073741824 Sep 10 18:25:21 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] Acquiring lock "cinder-quobyte-98b13dbf-553f-4886-8703-d7e102e2895f" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] Lock "cinder-quobyte-98b13dbf-553f-4886-8703-d7e102e2895f" acquired by "delete_volume" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7117534-3375-4e1d-9d51-285074bf6899]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-6b25873f-4411-40d8-b797-e678de9954ce req-717acb6b-5eaa-479f-9ae6-c914b1de7316 tempest-AttachVolumeTestJSON-1356128937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:25:21 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f Sep 10 18:25:21 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Flow 'volume_create_manager' (05679247-5a9a-4159-8035-8cca7bf06732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c130045-bbe7-43ac-884d-1d54952ac671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c130045-bbe7-43ac-884d-1d54952ac671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1525677229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb9f825-59d8-4331-906a-8f2de34630e7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='794cac45017a4d599ee1d9202f638787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:25:21Z,use_quota=True,user_id='245f170423c5487c87e1b7fc86593a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143339b1-9ca5-420e-ae19-b45a6b84d7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143339b1-9ca5-420e-ae19-b45a6b84d7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d259c5f-acb9-4305-aa91-a8f4551966b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d259c5f-acb9-4305-aa91-a8f4551966b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfb9f825-59d8-4331-906a-8f2de34630e7', 'volume_name': 'volume-dfb9f825-59d8-4331-906a-8f2de34630e7', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02dc7060-3d15-4da7-bfea-067bc2d0238b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02dc7060-3d15-4da7-bfea-067bc2d0238b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d08589d-8995-4103-ad40-548670e696be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:21 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Volume dfb9f825-59d8-4331-906a-8f2de34630e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfb9f825-59d8-4331-906a-8f2de34630e7', 'volume_size': 1} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:21 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-73ae7066-19ca-498d-bd58-7181495c634c 1073741824" returned: 0 in 0.466s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-73ae7066-19ca-498d-bd58-7181495c634c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:21 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-73ae7066-19ca-498d-bd58-7181495c634c Sep 10 18:25:21 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:21 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f" returned: 0 in 0.414s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:21 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f Sep 10 18:25:21 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:21 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-73ae7066-19ca-498d-bd58-7181495c634c" returned: 0 in 0.263s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-6b25873f-4411-40d8-b797-e678de9954ce req-717acb6b-5eaa-479f-9ae6-c914b1de7316 tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.577s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f99f18ff-15a0-48f9-9fd5-2eed2a4cb0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ae7066-19ca-498d-bd58-7181495c634c', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d919267-096e-497d-8a61-e21ecd1db2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-6b25873f-4411-40d8-b797-e678de9954ce req-717acb6b-5eaa-479f-9ae6-c914b1de7316 tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.420s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1525677229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb9f825-59d8-4331-906a-8f2de34630e7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='794cac45017a4d599ee1d9202f638787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:25:21Z,use_quota=True,user_id='245f170423c5487c87e1b7fc86593a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Creating volume dfb9f825-59d8-4331-906a-8f2de34630e7 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:25:21 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dfb9f825-59d8-4331-906a-8f2de34630e7 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:21 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Volume volume-73ae7066-19ca-498d-bd58-7181495c634c (73ae7066-19ca-498d-bd58-7181495c634c): created successfully Sep 10 18:25:21 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dfb9f825-59d8-4331-906a-8f2de34630e7 1073741824 Sep 10 18:25:21 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d919267-096e-497d-8a61-e21ecd1db2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:21 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Flow 'volume_create_manager' (4340621a-00d1-49c4-824d-3091ca91e64f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-98b13dbf-553f-4886-8703-d7e102e2895f" returned: 0 in 0.270s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:21 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-fea36160-14dd-45a8-85c9-491c81cfcb77 tempest-ServersNegativeTestJSON-795997211 None] Created volume successfully. Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] Lock "cinder-quobyte-98b13dbf-553f-4886-8703-d7e102e2895f" released by "delete_volume" :: held 0.767s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-6b25873f-4411-40d8-b797-e678de9954ce req-717acb6b-5eaa-479f-9ae6-c914b1de7316 tempest-AttachVolumeTestJSON-1356128937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-c3fb1602-8e39-4ca7-896b-5603e5691aab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71632e8f-0605-48f8-8679-c4c77a2dbbc1', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] Created reservations ['f6d5a112-80b5-46e8-af7e-b6c3d98977f3', '1adac293-9c41-4ada-b455-9d3bfe75ef3a', '62e45a51-90b8-4cb6-b1dd-cd48bcfa0199', '9ffb9ab5-3e6d-4b38-8b0c-c93fd84ddb3c'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:25:22 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-6b25873f-4411-40d8-b797-e678de9954ce req-717acb6b-5eaa-479f-9ae6-c914b1de7316 tempest-AttachVolumeTestJSON-1356128937 None] attachment_update completed successfully. Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:22 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:25:22 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:22 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dfb9f825-59d8-4331-906a-8f2de34630e7 1073741824" returned: 0 in 0.663s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dfb9f825-59d8-4331-906a-8f2de34630e7 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:22 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dfb9f825-59d8-4331-906a-8f2de34630e7 Sep 10 18:25:22 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:22 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] Acquiring lock "cinder-73ae7066-19ca-498d-bd58-7181495c634c-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.401s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:25:22 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] Deleted volume successfully. Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] Lock "cinder-73ae7066-19ca-498d-bd58-7181495c634c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d4e1a556-81eb-4d57-b963-7af3b35d03fc tempest-VolumesCloneTest-1410361681 None] Lock "cinder-98b13dbf-553f-4886-8703-d7e102e2895f-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] Acquiring lock "cinder-quobyte-73ae7066-19ca-498d-bd58-7181495c634c" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] Lock "cinder-quobyte-73ae7066-19ca-498d-bd58-7181495c634c" acquired by "delete_volume" :: waited 0.020s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1850419b-1df9-4912-94d7-e6c737707b66]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-73ae7066-19ca-498d-bd58-7181495c634c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:22 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dfb9f825-59d8-4331-906a-8f2de34630e7" returned: 0 in 0.330s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d08589d-8995-4103-ad40-548670e696be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb9f825-59d8-4331-906a-8f2de34630e7', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0abf843-42dd-4fd8-bd80-972cadc80c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:22 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-73ae7066-19ca-498d-bd58-7181495c634c Sep 10 18:25:22 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:22 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Volume volume-dfb9f825-59d8-4331-906a-8f2de34630e7 (dfb9f825-59d8-4331-906a-8f2de34630e7): created successfully Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0abf843-42dd-4fd8-bd80-972cadc80c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Flow 'volume_create_manager' (05679247-5a9a-4159-8035-8cca7bf06732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:25:22 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-ab82831b-4885-4826-837a-4260b18454fb req-f7500e37-a8f4-4c8a-a568-936297f3a067 tempest-VolumesGetTestJSON-731213080 None] Created volume successfully. Sep 10 18:25:23 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-73ae7066-19ca-498d-bd58-7181495c634c" returned: 0 in 0.390s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-73ae7066-19ca-498d-bd58-7181495c634c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:23 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-73ae7066-19ca-498d-bd58-7181495c634c Sep 10 18:25:23 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:23 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-73ae7066-19ca-498d-bd58-7181495c634c" returned: 0 in 0.261s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] Lock "cinder-quobyte-73ae7066-19ca-498d-bd58-7181495c634c" released by "delete_volume" :: held 0.733s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:23 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] Created reservations ['5f4b07c4-0473-4432-8492-9bf98c0c6065', '3c46fa00-71cc-4e48-9fdd-a2a5655812c4', '499e171e-2527-4f2a-9854-90e58af36549', 'f24d0838-0f28-4255-9c93-cc7dc84bd58c'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:25:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:23 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:25:23 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] Acquiring lock "cinder-aadd6abf-9ff0-41b3-8ef0-825e280fff04-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] Lock "cinder-aadd6abf-9ff0-41b3-8ef0-825e280fff04-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:23 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.311s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:23 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:25:23 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] Deleted volume successfully. Sep 10 18:25:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] Acquiring lock "cinder-quobyte-aadd6abf-9ff0-41b3-8ef0-825e280fff04" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-808632e1-c49c-43e5-9958-4b88b8f9248e tempest-ServersNegativeTestJSON-795997211 None] Lock "cinder-73ae7066-19ca-498d-bd58-7181495c634c-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] Lock "cinder-quobyte-aadd6abf-9ff0-41b3-8ef0-825e280fff04" acquired by "delete_volume" :: waited 0.032s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:24 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a68b97c-79c5-4cfd-a7d9-236f710b76b3]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aadd6abf-9ff0-41b3-8ef0-825e280fff04 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:24 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] Acquiring lock "cinder-dfb9f825-59d8-4331-906a-8f2de34630e7-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:24 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] Lock "cinder-dfb9f825-59d8-4331-906a-8f2de34630e7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:24 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] Acquiring lock "cinder-quobyte-dfb9f825-59d8-4331-906a-8f2de34630e7" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:24 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] Lock "cinder-quobyte-dfb9f825-59d8-4331-906a-8f2de34630e7" acquired by "delete_volume" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:24 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aadd6abf-9ff0-41b3-8ef0-825e280fff04 Sep 10 18:25:24 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:24 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa216e2-a276-4647-bf1b-8eb5c3818e21]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dfb9f825-59d8-4331-906a-8f2de34630e7 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:24 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dfb9f825-59d8-4331-906a-8f2de34630e7 Sep 10 18:25:24 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:24 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aadd6abf-9ff0-41b3-8ef0-825e280fff04" returned: 0 in 0.512s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aadd6abf-9ff0-41b3-8ef0-825e280fff04 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:24 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aadd6abf-9ff0-41b3-8ef0-825e280fff04 Sep 10 18:25:24 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:24 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dfb9f825-59d8-4331-906a-8f2de34630e7" returned: 0 in 0.536s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dfb9f825-59d8-4331-906a-8f2de34630e7 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:24 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dfb9f825-59d8-4331-906a-8f2de34630e7 Sep 10 18:25:24 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:24 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aadd6abf-9ff0-41b3-8ef0-825e280fff04" returned: 0 in 0.372s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:24 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] Lock "cinder-quobyte-aadd6abf-9ff0-41b3-8ef0-825e280fff04" released by "delete_volume" :: held 0.958s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] Created reservations ['13a4ba6d-c3a2-4f0a-810b-ec8f8d60d117', '7e3ea3e3-926e-424b-8150-51e79d53cf60', 'b307967a-a85b-4b73-83a0-1b6e9374cb20', '3c33d0e4-23a0-4069-b243-686819afb4c9'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:25 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dfb9f825-59d8-4331-906a-8f2de34630e7" returned: 0 in 0.318s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:25 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:25:25 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] Lock "cinder-quobyte-dfb9f825-59d8-4331-906a-8f2de34630e7" released by "delete_volume" :: held 0.914s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG cinder.quota [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] Created reservations ['b526b98c-2435-4950-bc23-c89667fbbd07', 'f7c91618-98c4-4f2b-8f8a-e43fb8e8be0c', '813721ce-24f7-4d32-9020-e161ab8b99f6', '4bb1b227-6c60-4098-ac5e-7de608a7bfc9'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:25 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:25:25 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:25 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.301s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:25:25 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] Deleted volume successfully. Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8388775b-a05d-4fa7-ad96-30de838f3f26 tempest-ServersNegativeTestJSON-795997211 None] Lock "cinder-aadd6abf-9ff0-41b3-8ef0-825e280fff04-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:25 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.330s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG cinder.manager [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:25:25 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] Deleted volume successfully. Sep 10 18:25:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-b5689dc4-ec29-4bf6-a050-8b381626968a req-8f4087b4-c4bf-4cb1-b917-2712a98a5f1c tempest-VolumesGetTestJSON-731213080 None] Lock "cinder-dfb9f825-59d8-4331-906a-8f2de34630e7-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=89,cinder:UPDATE=109,cinder:INSERT=29,cinder:DELETE=9 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:25:29 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:25:29 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Flow 'volume_create_manager' (b8c36e20-71bd-4add-a68e-699dd341794e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63075546-dc0a-4787-a0a7-3377f7de595f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63075546-dc0a-4787-a0a7-3377f7de595f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-449370897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287ca1d0-9453-4255-81a4-4d50281e5a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6945c339b649289ce5555c2690ddb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:25:29Z,use_quota=True,user_id='1435d2a7ff964f1ca73e15b8b95e338d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf57ac0a-9feb-44c1-8032-fd841a83754c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf57ac0a-9feb-44c1-8032-fd841a83754c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc950892-e27e-418c-9522-2bb1f0f6f0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc950892-e27e-418c-9522-2bb1f0f6f0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '287ca1d0-9453-4255-81a4-4d50281e5a72', 'volume_name': 'volume-287ca1d0-9453-4255-81a4-4d50281e5a72', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc030819-fe3a-41f4-a73e-4bb159741867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc030819-fe3a-41f4-a73e-4bb159741867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9579c034-dc4f-4568-9fcf-168835be9b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:29 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Volume 287ca1d0-9453-4255-81a4-4d50281e5a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-287ca1d0-9453-4255-81a4-4d50281e5a72', 'volume_size': 1} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-449370897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287ca1d0-9453-4255-81a4-4d50281e5a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6945c339b649289ce5555c2690ddb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:25:29Z,use_quota=True,user_id='1435d2a7ff964f1ca73e15b8b95e338d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Creating volume 287ca1d0-9453-4255-81a4-4d50281e5a72 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:25:29 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:29 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72 1073741824 Sep 10 18:25:29 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:29 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.514s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 28 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:25:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:25:30 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72 1073741824" returned: 0 in 0.739s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:30 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:UPDATE=98,cinder:SELECT=85,cinder:INSERT=30,cinder:DELETE=8 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:25:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:30 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72 Sep 10 18:25:30 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:30 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72" returned: 0 in 0.493s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:25:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9579c034-dc4f-4568-9fcf-168835be9b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287ca1d0-9453-4255-81a4-4d50281e5a72', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36948b8-8337-4aa1-a68f-f40df1bdab23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:30 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Volume volume-287ca1d0-9453-4255-81a4-4d50281e5a72 (287ca1d0-9453-4255-81a4-4d50281e5a72): created successfully Sep 10 18:25:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36948b8-8337-4aa1-a68f-f40df1bdab23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Flow 'volume_create_manager' (b8c36e20-71bd-4add-a68e-699dd341794e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:25:30 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-bd78e133-6440-4513-8668-22401fffacfa tempest-VolumesSnapshotListTestJSON-1384437873 None] Created volume successfully. Sep 10 18:25:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-269c96be-b7bb-4880-ba4e-88dcc5437d53 tempest-VolumesSnapshotListTestJSON-1384437873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-269c96be-b7bb-4880-ba4e-88dcc5437d53 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:31 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-269c96be-b7bb-4880-ba4e-88dcc5437d53 tempest-VolumesSnapshotListTestJSON-1384437873 None] Creating offline snapshot 1e047269-c224-4f01-a4cf-e22511137a3e of volume 287ca1d0-9453-4255-81a4-4d50281e5a72 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:25:31 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[43892623-3619-4ab4-adf2-fda397ac2e54]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-269c96be-b7bb-4880-ba4e-88dcc5437d53 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:31 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72 Sep 10 18:25:31 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:32 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-269c96be-b7bb-4880-ba4e-88dcc5437d53 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72" returned: 0 in 0.479s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-269c96be-b7bb-4880-ba4e-88dcc5437d53 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:32 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e 1G Sep 10 18:25:32 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:32 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-269c96be-b7bb-4880-ba4e-88dcc5437d53 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e 1G" returned: 0 in 0.748s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-269c96be-b7bb-4880-ba4e-88dcc5437d53 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287ca1d0-9453-4255-81a4-4d50281e5a72 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:32 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287ca1d0-9453-4255-81a4-4d50281e5a72 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e Sep 10 18:25:32 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:33 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-269c96be-b7bb-4880-ba4e-88dcc5437d53 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287ca1d0-9453-4255-81a4-4d50281e5a72 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e" returned: 0 in 0.452s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:33 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-269c96be-b7bb-4880-ba4e-88dcc5437d53 tempest-VolumesSnapshotListTestJSON-1384437873 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e is being set with open permissions: ugo+rw Sep 10 18:25:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-269c96be-b7bb-4880-ba4e-88dcc5437d53 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:33 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e Sep 10 18:25:33 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:33 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-269c96be-b7bb-4880-ba4e-88dcc5437d53 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e" returned: 0 in 0.305s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-269c96be-b7bb-4880-ba4e-88dcc5437d53 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:33 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.info Sep 10 18:25:33 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:34 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-269c96be-b7bb-4880-ba4e-88dcc5437d53 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.info" returned: 0 in 0.380s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:34 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-269c96be-b7bb-4880-ba4e-88dcc5437d53 tempest-VolumesSnapshotListTestJSON-1384437873 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.info is being set with open permissions: ugo+rw Sep 10 18:25:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-269c96be-b7bb-4880-ba4e-88dcc5437d53 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:34 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.info Sep 10 18:25:34 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:34 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-269c96be-b7bb-4880-ba4e-88dcc5437d53 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.info" returned: 0 in 0.387s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-269c96be-b7bb-4880-ba4e-88dcc5437d53 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.901s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:34 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-269c96be-b7bb-4880-ba4e-88dcc5437d53 tempest-VolumesSnapshotListTestJSON-1384437873 None] Create snapshot completed successfully Sep 10 18:25:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-da2883f9-2691-4be0-8b3b-e33722f5b8cd tempest-VolumesSnapshotListTestJSON-1384437873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-da2883f9-2691-4be0-8b3b-e33722f5b8cd tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:35 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-da2883f9-2691-4be0-8b3b-e33722f5b8cd tempest-VolumesSnapshotListTestJSON-1384437873 None] Creating offline snapshot a9045986-0fbb-4ae4-b759-90500abb2641 of volume 287ca1d0-9453-4255-81a4-4d50281e5a72 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:25:35 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d08a522-afc6-43b4-a9f0-3ecb798bc35d]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-da2883f9-2691-4be0-8b3b-e33722f5b8cd tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:35 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e Sep 10 18:25:35 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:35 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-da2883f9-2691-4be0-8b3b-e33722f5b8cd tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e" returned: 0 in 0.530s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:35 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-da2883f9-2691-4be0-8b3b-e33722f5b8cd tempest-VolumesSnapshotListTestJSON-1384437873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-287ca1d0-9453-4255-81a4-4d50281e5a72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:25:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-da2883f9-2691-4be0-8b3b-e33722f5b8cd tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:35 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 1G Sep 10 18:25:35 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:36 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-da2883f9-2691-4be0-8b3b-e33722f5b8cd tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 1G" returned: 0 in 0.540s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-da2883f9-2691-4be0-8b3b-e33722f5b8cd tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:36 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 Sep 10 18:25:36 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:36 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-da2883f9-2691-4be0-8b3b-e33722f5b8cd tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641" returned: 0 in 0.474s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:36 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-da2883f9-2691-4be0-8b3b-e33722f5b8cd tempest-VolumesSnapshotListTestJSON-1384437873 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 is being set with open permissions: ugo+rw Sep 10 18:25:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-da2883f9-2691-4be0-8b3b-e33722f5b8cd tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:36 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 Sep 10 18:25:36 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:37 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-da2883f9-2691-4be0-8b3b-e33722f5b8cd tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641" returned: 0 in 0.325s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-da2883f9-2691-4be0-8b3b-e33722f5b8cd tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:37 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-da2883f9-2691-4be0-8b3b-e33722f5b8cd tempest-VolumesSnapshotListTestJSON-1384437873 None] Create snapshot completed successfully Sep 10 18:25:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0c16f015-76a6-4b42-b028-ea6b7c0b4f07 tempest-VolumesSnapshotListTestJSON-1384437873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0c16f015-76a6-4b42-b028-ea6b7c0b4f07 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-0c16f015-76a6-4b42-b028-ea6b7c0b4f07 tempest-VolumesSnapshotListTestJSON-1384437873 None] Creating offline snapshot 7a4f19d7-779d-45a6-b8db-274e707b7285 of volume 287ca1d0-9453-4255-81a4-4d50281e5a72 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:25:37 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[937f69db-bd5c-40c5-b536-d9b8074e1ab7]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0c16f015-76a6-4b42-b028-ea6b7c0b4f07 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:37 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 Sep 10 18:25:37 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0c16f015-76a6-4b42-b028-ea6b7c0b4f07 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641" returned: 0 in 0.440s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-0c16f015-76a6-4b42-b028-ea6b7c0b4f07 tempest-VolumesSnapshotListTestJSON-1384437873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-287ca1d0-9453-4255-81a4-4d50281e5a72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:25:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0c16f015-76a6-4b42-b028-ea6b7c0b4f07 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:37 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:38 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285 1G Sep 10 18:25:38 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:38 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-689af662-2e02-411d-abe4-08faf1f2b283 tempest-GroupSnapshotsV319Test-1523007056 None] Group tempest-GroupSnapshotsV319Test-Group-242401786: creating Sep 10 18:25:38 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-689af662-2e02-411d-abe4-08faf1f2b283 tempest-GroupSnapshotsV319Test-1523007056 None] Group tempest-GroupSnapshotsV319Test-Group-242401786: created successfully Sep 10 18:25:38 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-689af662-2e02-411d-abe4-08faf1f2b283 tempest-GroupSnapshotsV319Test-1523007056 None] Create group completed successfully. Sep 10 18:25:38 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0c16f015-76a6-4b42-b028-ea6b7c0b4f07 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285 1G" returned: 0 in 0.526s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0c16f015-76a6-4b42-b028-ea6b7c0b4f07 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:38 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285 Sep 10 18:25:38 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:38 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0c16f015-76a6-4b42-b028-ea6b7c0b4f07 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285" returned: 0 in 0.303s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:38 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-0c16f015-76a6-4b42-b028-ea6b7c0b4f07 tempest-VolumesSnapshotListTestJSON-1384437873 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285 is being set with open permissions: ugo+rw Sep 10 18:25:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0c16f015-76a6-4b42-b028-ea6b7c0b4f07 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:38 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285 Sep 10 18:25:38 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:39 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0c16f015-76a6-4b42-b028-ea6b7c0b4f07 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285" returned: 0 in 0.305s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0c16f015-76a6-4b42-b028-ea6b7c0b4f07 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.671s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:39 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-0c16f015-76a6-4b42-b028-ea6b7c0b4f07 tempest-VolumesSnapshotListTestJSON-1384437873 None] Create snapshot completed successfully Sep 10 18:25:39 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:25:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Flow 'volume_create_manager' (d7ef2d38-8207-44f4-b563-05a1c02aa339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:25:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d80cf00-2da7-46c9-bd61-73ff635e8e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d80cf00-2da7-46c9-bd61-73ff635e8e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2059534181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=00e43a26-81f3-4524-8fd5-ef819e9f1838,host='devstack@QuobyteHD#QuobyteHD',id=6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60c473da8a4b4d02a8320635fbba7179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:25:40Z,use_quota=True,user_id='8add14546f2848a3a51b72d4b2508b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec739af9-ccd6-454a-a305-c8375f2a1695),volume_type_id=ec739af9-ccd6-454a-a305-c8375f2a1695)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7572a9-a597-4744-8cb9-75201682a3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7572a9-a597-4744-8cb9-75201682a3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c75ebf4-9be1-433c-8224-807b37baeea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c75ebf4-9be1-433c-8224-807b37baeea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765', 'volume_name': 'volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9c8117-e7a0-4de2-9af1-3f1089fdfcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9c8117-e7a0-4de2-9af1-3f1089fdfcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab473ed0-fbcc-4c82-8ec9-362b1dc7ccd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:40 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Volume 6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765', 'volume_size': 1} Sep 10 18:25:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:40 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=00e43a26-81f3-4524-8fd5-ef819e9f1838,created_at=2026-09-10T16:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2059534181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=00e43a26-81f3-4524-8fd5-ef819e9f1838,host='devstack@QuobyteHD#QuobyteHD',id=6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60c473da8a4b4d02a8320635fbba7179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:25:40Z,use_quota=True,user_id='8add14546f2848a3a51b72d4b2508b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec739af9-ccd6-454a-a305-c8375f2a1695),volume_type_id=ec739af9-ccd6-454a-a305-c8375f2a1695)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:25:40 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Creating volume 6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:25:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:40 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:40 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:40 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:25:40 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:25:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:40 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 1073741824 Sep 10 18:25:40 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:40 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 1073741824" returned: 0 in 0.639s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:40 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 Sep 10 18:25:40 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:41 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765" returned: 0 in 0.449s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab473ed0-fbcc-4c82-8ec9-362b1dc7ccd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ddff8b9-9b9f-42e7-8861-63cbb3bb49f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] Acquiring lock "cinder-7a4f19d7-779d-45a6-b8db-274e707b7285-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:41 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Volume volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 (6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765): created successfully Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ddff8b9-9b9f-42e7-8861-63cbb3bb49f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Flow 'volume_create_manager' (d7ef2d38-8207-44f4-b563-05a1c02aa339) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:25:41 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-8efb8d9c-e141-44a3-98b0-186967827d52 tempest-GroupSnapshotsV319Test-1523007056 None] Created volume successfully. Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-7a4f19d7-779d-45a6-b8db-274e707b7285-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] Acquiring lock "cinder-quobyte-287ca1d0-9453-4255-81a4-4d50281e5a72" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-quobyte-287ca1d0-9453-4255-81a4-4d50281e5a72" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] Acquiring lock "cinder-quobyte-7a4f19d7-779d-45a6-b8db-274e707b7285" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-quobyte-7a4f19d7-779d-45a6-b8db-274e707b7285" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] Deleting offline snapshot 7a4f19d7-779d-45a6-b8db-274e707b7285 of volume 287ca1d0-9453-4255-81a4-4d50281e5a72 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] snapshot_file for this snap is: volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f63f2d9-ab24-4f2d-9038-1fcf0f6ea465]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:41 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285 Sep 10 18:25:41 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:41 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285" returned: 0 in 0.460s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-287ca1d0-9453-4255-81a4-4d50281e5a72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4a0844-5a0b-4ca7-8a90-882c4de83c1c]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:42 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 Sep 10 18:25:42 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:42 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641" returned: 0 in 0.394s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-287ca1d0-9453-4255-81a4-4d50281e5a72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:25:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:42 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285 Sep 10 18:25:42 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:42 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] GroupSnapshot 3091f71c-bffd-4226-b7a6-0683d1c82341: creating. Sep 10 18:25:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] Group snapshot 3091f71c-bffd-4226-b7a6-0683d1c82341: creating. {{(pid=87842) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 10 18:25:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] Creating offline snapshot c5b2ec36-c840-4cd7-bd31-ba4c29312fd7 of volume 6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:25:42 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285" returned: 0 in 0.599s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:42 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37ef2b8-43cb-4afd-b9ff-24422f9a0190]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:42 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285 Sep 10 18:25:42 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:43 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 Sep 10 18:25:43 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:43 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.7a4f19d7-779d-45a6-b8db-274e707b7285" returned: 0 in 0.278s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-quobyte-7a4f19d7-779d-45a6-b8db-274e707b7285" released by "_delete_snapshot" :: held 1.877s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-quobyte-287ca1d0-9453-4255-81a4-4d50281e5a72" released by "delete_snapshot" :: held 1.916s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:43 devstack cinder-volume[87842]: WARNING cinder.quota [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:25:43 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] Created reservations ['37238712-abba-452b-81b7-9c488b209636', 'd94e732a-748c-4094-8980-3f48f62ae127', '2b99c3cb-3d6f-4a13-a814-9f074b5723e7', '9af44bf5-6ca0-427b-a306-742370bd1389'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:25:43 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] Delete snapshot completed successfully. Sep 10 18:25:43 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-00940ffc-32db-46db-9d04-b46e33c73b0d tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-7a4f19d7-779d-45a6-b8db-274e707b7285-delete_snapshot" released by "delete_snapshot" :: held 2.116s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765" returned: 0 in 0.532s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:43 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7 1G Sep 10 18:25:43 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] Acquiring lock "cinder-a9045986-0fbb-4ae4-b759-90500abb2641-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-a9045986-0fbb-4ae4-b759-90500abb2641-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] Acquiring lock "cinder-quobyte-287ca1d0-9453-4255-81a4-4d50281e5a72" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-quobyte-287ca1d0-9453-4255-81a4-4d50281e5a72" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] Acquiring lock "cinder-quobyte-a9045986-0fbb-4ae4-b759-90500abb2641" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-quobyte-a9045986-0fbb-4ae4-b759-90500abb2641" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] Deleting offline snapshot a9045986-0fbb-4ae4-b759-90500abb2641 of volume 287ca1d0-9453-4255-81a4-4d50281e5a72 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:25:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] snapshot_file for this snap is: volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:25:43 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a582259-147f-4ab1-9cc4-3bd6a39fc281]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:43 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 Sep 10 18:25:43 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:44 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7 1G" returned: 0 in 0.557s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:44 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7 Sep 10 18:25:44 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:44 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641" returned: 0 in 0.521s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-287ca1d0-9453-4255-81a4-4d50281e5a72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:25:44 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[806cff9b-376c-4914-96ec-111369fcff4e]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:44 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7" returned: 0 in 0.379s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:44 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7 is being set with open permissions: ugo+rw: NotImplementedError Sep 10 18:25:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:44 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7 Sep 10 18:25:44 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:44 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e Sep 10 18:25:44 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:44 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7" returned: 0 in 0.313s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:44 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e" returned: 0 in 0.473s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-287ca1d0-9453-4255-81a4-4d50281e5a72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:25:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:44 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.info Sep 10 18:25:44 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:44 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 Sep 10 18:25:44 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:45 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.info" returned: 0 in 0.360s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:45 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.info is being set with open permissions: ugo+rw: NotImplementedError Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:45 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.info Sep 10 18:25:45 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:45 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641" returned: 0 in 0.395s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:45 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641 Sep 10 18:25:45 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:45 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.info" returned: 0 in 0.319s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.602s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:45 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.a9045986-0fbb-4ae4-b759-90500abb2641" returned: 0 in 0.333s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-quobyte-a9045986-0fbb-4ae4-b759-90500abb2641" released by "_delete_snapshot" :: held 1.859s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-quobyte-287ca1d0-9453-4255-81a4-4d50281e5a72" released by "delete_snapshot" :: held 1.901s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:45 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-0294f319-d123-423c-b562-0327a5445d0b tempest-GroupSnapshotsV319Test-1523007056 None] group_snapshot 3091f71c-bffd-4226-b7a6-0683d1c82341: created successfully Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] Created reservations ['8afcff8b-77a9-488d-9f8d-c2e12bdbc64a', '41d45b92-d44e-4c27-acd8-c9e7fbc4a4e0', '3409bc78-5103-4ab2-88c4-42d594e3306a', 'b00c7020-1cd6-4274-9f88-064999f4a426'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:25:45 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] Delete snapshot completed successfully. Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5cff793b-88f8-40dc-96d5-b352e91341d1 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-a9045986-0fbb-4ae4-b759-90500abb2641-delete_snapshot" released by "delete_snapshot" :: held 2.082s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] Acquiring lock "cinder-1e047269-c224-4f01-a4cf-e22511137a3e-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-1e047269-c224-4f01-a4cf-e22511137a3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] Acquiring lock "cinder-quobyte-287ca1d0-9453-4255-81a4-4d50281e5a72" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-quobyte-287ca1d0-9453-4255-81a4-4d50281e5a72" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] Acquiring lock "cinder-quobyte-1e047269-c224-4f01-a4cf-e22511137a3e" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-quobyte-1e047269-c224-4f01-a4cf-e22511137a3e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] Deleting offline snapshot 1e047269-c224-4f01-a4cf-e22511137a3e of volume 287ca1d0-9453-4255-81a4-4d50281e5a72 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] snapshot_file for this snap is: volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bf4351-4333-4d11-865c-162df1160362]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:45 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e Sep 10 18:25:45 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:46 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e" returned: 0 in 0.421s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-287ca1d0-9453-4255-81a4-4d50281e5a72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:25:46 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7a5015-cfa7-40f9-a482-033ca0949d46]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:46 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72 Sep 10 18:25:46 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:46 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] group_snapshot 3091f71c-bffd-4226-b7a6-0683d1c82341: deleting Sep 10 18:25:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] group_snapshot 3091f71c-bffd-4226-b7a6-0683d1c82341: deleting {{(pid=87842) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 10 18:25:46 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] Acquiring lock "cinder-quobyte-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:46 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] Lock "cinder-quobyte-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:46 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] Acquiring lock "cinder-quobyte-c5b2ec36-c840-4cd7-bd31-ba4c29312fd7" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:46 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] Lock "cinder-quobyte-c5b2ec36-c840-4cd7-bd31-ba4c29312fd7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] Deleting offline snapshot c5b2ec36-c840-4cd7-bd31-ba4c29312fd7 of volume 6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:25:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] snapshot_file for this snap is: volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:25:46 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a68654-93fa-4ae4-8260-5a25ff657860]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:46 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72" returned: 0 in 0.565s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:46 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e Sep 10 18:25:46 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:46 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7 Sep 10 18:25:47 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:47 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7" returned: 0 in 0.470s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:25:47 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e" returned: 0 in 0.446s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:47 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6beb5353-ecbc-4063-b2a6-21e4cb7b21ef]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:47 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e Sep 10 18:25:47 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:47 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 Sep 10 18:25:47 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:47 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72.1e047269-c224-4f01-a4cf-e22511137a3e" returned: 0 in 0.330s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:47 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-quobyte-1e047269-c224-4f01-a4cf-e22511137a3e" released by "_delete_snapshot" :: held 1.919s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:47 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-quobyte-287ca1d0-9453-4255-81a4-4d50281e5a72" released by "delete_snapshot" :: held 1.949s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:47 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765" returned: 0 in 0.482s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:47 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] Created reservations ['0c9503ee-c639-4cde-a388-d6a58379de40', '35fca998-702c-44b0-a732-c6bc23ba1a44', '6d21a35f-710c-4755-ab3f-34370008a6e6', '30e1be79-32ac-44fc-bdc0-2fadec828d91'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:25:47 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7 Sep 10 18:25:47 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:47 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] Delete snapshot completed successfully. Sep 10 18:25:47 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-41a5718c-9bb4-4446-9f84-cc32ecb86760 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-1e047269-c224-4f01-a4cf-e22511137a3e-delete_snapshot" released by "delete_snapshot" :: held 2.179s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:48 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7" returned: 0 in 0.450s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:48 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7 Sep 10 18:25:48 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:48 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765.c5b2ec36-c840-4cd7-bd31-ba4c29312fd7" returned: 0 in 0.276s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] Lock "cinder-quobyte-c5b2ec36-c840-4cd7-bd31-ba4c29312fd7" released by "_delete_snapshot" :: held 1.846s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] Lock "cinder-quobyte-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765" released by "delete_snapshot" :: held 1.876s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:48 devstack cinder-volume[87842]: WARNING cinder.quota [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-531884930 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-531884930, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:25:48 devstack cinder-volume[87842]: WARNING cinder.quota [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-531884930 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-531884930, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:25:48 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] Created reservations ['2a96a5fa-05f3-4c23-9816-850bdf9dca02', '3901aec3-beea-47af-a790-e9966c3b234e', 'f5c65e89-8448-4156-bbca-93ef239d840a', '4d2cd1ea-7213-4eab-87c2-599500b8e6a2'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:25:48 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d46c54ec-4cd7-445f-86a9-ce790d9e0bd3 tempest-GroupSnapshotsV319Test-1523007056 None] group_snapshot 3091f71c-bffd-4226-b7a6-0683d1c82341: deleted successfully Sep 10 18:25:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] Acquiring lock "cinder-287ca1d0-9453-4255-81a4-4d50281e5a72-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-287ca1d0-9453-4255-81a4-4d50281e5a72-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] Acquiring lock "cinder-quobyte-287ca1d0-9453-4255-81a4-4d50281e5a72" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-quobyte-287ca1d0-9453-4255-81a4-4d50281e5a72" acquired by "delete_volume" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:49 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34124b2-8f11-412e-8a2e-4bc5c2fcc10a]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7f1dc652-296e-46da-8fc3-99a57ba56bc9 tempest-GroupSnapshotsV319Test-1523007056 None] Acquiring lock "cinder-quobyte-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:25:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7f1dc652-296e-46da-8fc3-99a57ba56bc9 tempest-GroupSnapshotsV319Test-1523007056 None] Lock "cinder-quobyte-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:25:49 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[293973dc-aff6-45f7-8395-4d785d25f116]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:25:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f1dc652-296e-46da-8fc3-99a57ba56bc9 tempest-GroupSnapshotsV319Test-1523007056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:49 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72 Sep 10 18:25:49 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:49 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 Sep 10 18:25:49 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:49 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72" returned: 0 in 0.487s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:49 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72 Sep 10 18:25:49 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:49 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f1dc652-296e-46da-8fc3-99a57ba56bc9 tempest-GroupSnapshotsV319Test-1523007056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765" returned: 0 in 0.421s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f1dc652-296e-46da-8fc3-99a57ba56bc9 tempest-GroupSnapshotsV319Test-1523007056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:49 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765 Sep 10 18:25:49 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:50 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-287ca1d0-9453-4255-81a4-4d50281e5a72" returned: 0 in 0.298s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-quobyte-287ca1d0-9453-4255-81a4-4d50281e5a72" released by "delete_volume" :: held 0.891s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:50 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f1dc652-296e-46da-8fc3-99a57ba56bc9 tempest-GroupSnapshotsV319Test-1523007056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765" returned: 0 in 0.338s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7f1dc652-296e-46da-8fc3-99a57ba56bc9 tempest-GroupSnapshotsV319Test-1523007056 None] Lock "cinder-quobyte-6ba9a26e-aa5a-48e4-8bd5-4bfac7eb6765" released by "delete_volume" :: held 0.836s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] Created reservations ['4e78932e-75ce-445f-9c5e-f7e813241116', '94b4c94c-b871-4923-b2b2-e51c8b139f80', 'e1cd6d57-dfe3-4333-a791-80e4421b67de', '62b46187-a891-4755-9791-ec5785671ad4'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-7f1dc652-296e-46da-8fc3-99a57ba56bc9 tempest-GroupSnapshotsV319Test-1523007056 None] Created reservations ['31cc18bb-a779-4c66-bf39-a08f3384f442'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:50 devstack cinder-volume[87842]: WARNING cinder.quota [None req-7f1dc652-296e-46da-8fc3-99a57ba56bc9 tempest-GroupSnapshotsV319Test-1523007056 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-531884930 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-531884930, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:25:50 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:25:50 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-7f1dc652-296e-46da-8fc3-99a57ba56bc9 tempest-GroupSnapshotsV319Test-1523007056 None] Created reservations ['2511de9c-6536-47a0-a28e-7b8ff3b83c76', '88f1a938-b881-4255-b047-83b878c6d2e1', '85a5e69a-a562-43e2-b1f3-3516ae81e215', 'dfeab7fc-393e-44fd-be56-f9e88c30f989'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7f1dc652-296e-46da-8fc3-99a57ba56bc9 tempest-GroupSnapshotsV319Test-1523007056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7f1dc652-296e-46da-8fc3-99a57ba56bc9 tempest-GroupSnapshotsV319Test-1523007056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7f1dc652-296e-46da-8fc3-99a57ba56bc9 tempest-GroupSnapshotsV319Test-1523007056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7f1dc652-296e-46da-8fc3-99a57ba56bc9 tempest-GroupSnapshotsV319Test-1523007056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7f1dc652-296e-46da-8fc3-99a57ba56bc9 tempest-GroupSnapshotsV319Test-1523007056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f1dc652-296e-46da-8fc3-99a57ba56bc9 tempest-GroupSnapshotsV319Test-1523007056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:50 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:25:50 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:50 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.399s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:25:50 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] Deleted volume successfully. Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6a8d5f36-a19e-4c11-9863-84af9946e070 tempest-VolumesSnapshotListTestJSON-1384437873 None] Lock "cinder-287ca1d0-9453-4255-81a4-4d50281e5a72-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:25:50 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f1dc652-296e-46da-8fc3-99a57ba56bc9 tempest-GroupSnapshotsV319Test-1523007056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.320s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:50 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-7f1dc652-296e-46da-8fc3-99a57ba56bc9 tempest-GroupSnapshotsV319Test-1523007056 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:25:50 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-7f1dc652-296e-46da-8fc3-99a57ba56bc9 tempest-GroupSnapshotsV319Test-1523007056 None] Delete group completed successfully. Sep 10 18:25:54 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-6536d485-f99b-4165-8980-5348035d8a7b req-91fe1917-af03-420a-b07f-acbd55e79097 tempest-AttachVolumeTestJSON-1356128937 None] Terminate volume connection completed successfully. Sep 10 18:25:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-6536d485-f99b-4165-8980-5348035d8a7b req-91fe1917-af03-420a-b07f-acbd55e79097 tempest-AttachVolumeTestJSON-1356128937 None] Deleting attachment 71632e8f-0605-48f8-8679-c4c77a2dbbc1. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Flow 'volume_create_manager' (32bf16c8-8df4-425c-9798-0a51396bcdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b80483b-4c69-4c1c-bfd5-6be4cffff1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b80483b-4c69-4c1c-bfd5-6be4cffff1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-832673443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c63723c3-3237-4ea9-94e4-0ce7af47a70d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7079628626794d53a2064eedbc4223e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:25:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:25:58Z,use_quota=True,user_id='f481e0d640314be4b4617602079b3d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79b8f80-fa27-453d-af9d-76c688df3733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79b8f80-fa27-453d-af9d-76c688df3733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e08664-3038-413e-a3ee-bd8f08def5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e08664-3038-413e-a3ee-bd8f08def5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c63723c3-3237-4ea9-94e4-0ce7af47a70d', 'volume_name': 'volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d', 'volume_size': 2}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f6f768-0c29-4a6c-9ada-f297dbb85d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96f6f768-0c29-4a6c-9ada-f297dbb85d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73f4375-773c-4dae-b017-4aae913bf4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:58 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Volume c63723c3-3237-4ea9-94e4-0ce7af47a70d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d', 'volume_size': 2} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-832673443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c63723c3-3237-4ea9-94e4-0ce7af47a70d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7079628626794d53a2064eedbc4223e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:25:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:25:58Z,use_quota=True,user_id='f481e0d640314be4b4617602079b3d06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Creating volume c63723c3-3237-4ea9-94e4-0ce7af47a70d {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:25:58 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:25:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d 2147483648 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:58 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d 2147483648 Sep 10 18:25:58 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:59 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d 2147483648" returned: 0 in 0.769s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:25:59 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d Sep 10 18:25:59 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:25:59 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Sep 10 18:25:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d" returned: 0 in 0.576s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:25:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:25:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:25:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73f4375-773c-4dae-b017-4aae913bf4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d', 'volume_size': 2}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32b772d-742d-4324-801a-24093ff14b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:25:59 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Volume volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d (c63723c3-3237-4ea9-94e4-0ce7af47a70d): created successfully Sep 10 18:25:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32b772d-742d-4324-801a-24093ff14b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:25:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Flow 'volume_create_manager' (32bf16c8-8df4-425c-9798-0a51396bcdd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:25:59 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-df2ebfca-347e-4548-a316-e7653bcf172d tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Created volume successfully. Sep 10 18:26:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7f5f13ba-e965-41fb-b79d-0ab9d9e0286e tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7f5f13ba-e965-41fb-b79d-0ab9d9e0286e tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-7f5f13ba-e965-41fb-b79d-0ab9d9e0286e tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Creating offline snapshot 6959a21f-54e6-4a93-aac6-04de3576c3c4 of volume c63723c3-3237-4ea9-94e4-0ce7af47a70d {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:26:01 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6aa6f95-db5a-4994-a694-ab1e1bf8c408]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:26:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5f13ba-e965-41fb-b79d-0ab9d9e0286e tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:01 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d Sep 10 18:26:01 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:01 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5f13ba-e965-41fb-b79d-0ab9d9e0286e tempest-VolumesSnapshotNegativeTestJSON-940486952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d" returned: 0 in 0.722s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5f13ba-e965-41fb-b79d-0ab9d9e0286e tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4 2G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:01 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4 2G Sep 10 18:26:01 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:03 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5f13ba-e965-41fb-b79d-0ab9d9e0286e tempest-VolumesSnapshotNegativeTestJSON-940486952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4 2G" returned: 0 in 1.543s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5f13ba-e965-41fb-b79d-0ab9d9e0286e tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:03 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4 Sep 10 18:26:03 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:04 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5f13ba-e965-41fb-b79d-0ab9d9e0286e tempest-VolumesSnapshotNegativeTestJSON-940486952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4" returned: 0 in 1.146s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:04 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-7f5f13ba-e965-41fb-b79d-0ab9d9e0286e tempest-VolumesSnapshotNegativeTestJSON-940486952 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4 is being set with open permissions: ugo+rw Sep 10 18:26:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5f13ba-e965-41fb-b79d-0ab9d9e0286e tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:04 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4 Sep 10 18:26:04 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:04 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5f13ba-e965-41fb-b79d-0ab9d9e0286e tempest-VolumesSnapshotNegativeTestJSON-940486952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4" returned: 0 in 0.447s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5f13ba-e965-41fb-b79d-0ab9d9e0286e tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:05 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.info Sep 10 18:26:05 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:05 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5f13ba-e965-41fb-b79d-0ab9d9e0286e tempest-VolumesSnapshotNegativeTestJSON-940486952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.info" returned: 0 in 0.299s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:05 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-7f5f13ba-e965-41fb-b79d-0ab9d9e0286e tempest-VolumesSnapshotNegativeTestJSON-940486952 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.info is being set with open permissions: ugo+rw Sep 10 18:26:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5f13ba-e965-41fb-b79d-0ab9d9e0286e tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:05 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.info Sep 10 18:26:05 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:05 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5f13ba-e965-41fb-b79d-0ab9d9e0286e tempest-VolumesSnapshotNegativeTestJSON-940486952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.info" returned: 0 in 0.436s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7f5f13ba-e965-41fb-b79d-0ab9d9e0286e tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.753s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:05 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-7f5f13ba-e965-41fb-b79d-0ab9d9e0286e tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Create snapshot completed successfully Sep 10 18:26:06 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Acquiring lock "cinder-6959a21f-54e6-4a93-aac6-04de3576c3c4-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:26:06 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Lock "cinder-6959a21f-54e6-4a93-aac6-04de3576c3c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:26:06 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Acquiring lock "cinder-quobyte-c63723c3-3237-4ea9-94e4-0ce7af47a70d" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:26:06 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Lock "cinder-quobyte-c63723c3-3237-4ea9-94e4-0ce7af47a70d" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:26:06 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Acquiring lock "cinder-quobyte-6959a21f-54e6-4a93-aac6-04de3576c3c4" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:26:06 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Lock "cinder-quobyte-6959a21f-54e6-4a93-aac6-04de3576c3c4" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:26:06 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Deleting offline snapshot 6959a21f-54e6-4a93-aac6-04de3576c3c4 of volume c63723c3-3237-4ea9-94e4-0ce7af47a70d {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:26:06 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] snapshot_file for this snap is: volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:26:06 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[114a9577-df8c-449c-aa3a-8474e0ee4a77]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:26:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:06 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4 Sep 10 18:26:06 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:07 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4" returned: 0 in 0.773s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:07 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:26:07 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7913e9-8325-4187-bb8a-9b6b212a17a4]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:26:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:07 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d Sep 10 18:26:07 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:08 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d" returned: 0 in 0.702s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:08 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4 Sep 10 18:26:08 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:08 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4" returned: 0 in 0.732s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:08 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4 Sep 10 18:26:08 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:09 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d.6959a21f-54e6-4a93-aac6-04de3576c3c4" returned: 0 in 0.439s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Lock "cinder-quobyte-6959a21f-54e6-4a93-aac6-04de3576c3c4" released by "_delete_snapshot" :: held 2.951s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:26:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Lock "cinder-quobyte-c63723c3-3237-4ea9-94e4-0ce7af47a70d" released by "delete_snapshot" :: held 3.019s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:26:09 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Created reservations ['294a4783-ad26-48c0-ab0d-013af627d367', '83707a05-c616-49db-9f74-92e98db46e92', 'd8334e20-9944-4aea-b9a1-5336b8c02b0b', '0b8062e6-ff2e-4d6b-8e15-02ea4e84980a'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:26:09 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Delete snapshot completed successfully. Sep 10 18:26:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4b6f9027-b1e2-4751-aed9-749018829530 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Lock "cinder-6959a21f-54e6-4a93-aac6-04de3576c3c4-delete_snapshot" released by "delete_snapshot" :: held 3.353s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:26:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Acquiring lock "cinder-c63723c3-3237-4ea9-94e4-0ce7af47a70d-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:26:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Lock "cinder-c63723c3-3237-4ea9-94e4-0ce7af47a70d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:26:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Acquiring lock "cinder-quobyte-c63723c3-3237-4ea9-94e4-0ce7af47a70d" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:26:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Lock "cinder-quobyte-c63723c3-3237-4ea9-94e4-0ce7af47a70d" acquired by "delete_volume" :: waited 0.042s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:26:11 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[706531f3-2565-4a48-978c-8081a48908e8]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:26:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:11 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d Sep 10 18:26:11 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:11 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d" returned: 0 in 0.516s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:11 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d Sep 10 18:26:11 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:11 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c63723c3-3237-4ea9-94e4-0ce7af47a70d" returned: 0 in 0.409s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:11 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Lock "cinder-quobyte-c63723c3-3237-4ea9-94e4-0ce7af47a70d" released by "delete_volume" :: held 1.024s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:26:12 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Created reservations ['56e56d43-b5b1-4a11-a79a-0790f4f7eede', '202ca02f-9928-429d-9e07-c09a6c449e23', '96be1e76-60c3-4d1d-aea1-77f73f8c1599', 'f331af85-c657-4273-b5f8-c6ac9d3cf019'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:26:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:26:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:26:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:12 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:26:12 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:12 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.422s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:12 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:26:12 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Deleted volume successfully. Sep 10 18:26:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-539ff2a9-e914-4a3a-82af-2cc515b8fed4 tempest-VolumesSnapshotNegativeTestJSON-940486952 None] Lock "cinder-c63723c3-3237-4ea9-94e4-0ce7af47a70d-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Flow 'volume_create_manager' (b789a483-2e2d-4ea0-9217-776607e37302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77cf623d-ea97-4d65-97a7-4eaf035a8769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77cf623d-ea97-4d65-97a7-4eaf035a8769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-11462596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463e4b98-a37f-4347-a2b9-6f13b72ae5f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec91fca89624aa9a9686cab49101bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:26:21Z,use_quota=True,user_id='30716137b7304f51be34cd3ab6a01328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec3bc24-e7ef-4eea-931b-b0effb9fd094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec3bc24-e7ef-4eea-931b-b0effb9fd094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff256b7-3b69-4672-b676-ca0491d16558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff256b7-3b69-4672-b676-ca0491d16558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '463e4b98-a37f-4347-a2b9-6f13b72ae5f3', 'volume_name': 'volume-463e4b98-a37f-4347-a2b9-6f13b72ae5f3', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ec78b0-5263-423e-840a-cea8ad406334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ec78b0-5263-423e-840a-cea8ad406334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c03f84fa-c8de-496c-a9c7-1d2fec1b2e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:21 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Volume 463e4b98-a37f-4347-a2b9-6f13b72ae5f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-463e4b98-a37f-4347-a2b9-6f13b72ae5f3', 'volume_size': 1} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-11462596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463e4b98-a37f-4347-a2b9-6f13b72ae5f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec91fca89624aa9a9686cab49101bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:26:21Z,use_quota=True,user_id='30716137b7304f51be34cd3ab6a01328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Creating volume 463e4b98-a37f-4347-a2b9-6f13b72ae5f3 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:26:21 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-463e4b98-a37f-4347-a2b9-6f13b72ae5f3 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:21 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-463e4b98-a37f-4347-a2b9-6f13b72ae5f3 1073741824 Sep 10 18:26:21 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:21 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-463e4b98-a37f-4347-a2b9-6f13b72ae5f3 1073741824" returned: 0 in 0.494s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-463e4b98-a37f-4347-a2b9-6f13b72ae5f3 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:21 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-463e4b98-a37f-4347-a2b9-6f13b72ae5f3 Sep 10 18:26:21 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:21 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-463e4b98-a37f-4347-a2b9-6f13b72ae5f3" returned: 0 in 0.265s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c03f84fa-c8de-496c-a9c7-1d2fec1b2e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-463e4b98-a37f-4347-a2b9-6f13b72ae5f3', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04276c93-28f9-47e6-b117-a3248a970690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:21 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Volume volume-463e4b98-a37f-4347-a2b9-6f13b72ae5f3 (463e4b98-a37f-4347-a2b9-6f13b72ae5f3): created successfully Sep 10 18:26:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04276c93-28f9-47e6-b117-a3248a970690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Flow 'volume_create_manager' (b789a483-2e2d-4ea0-9217-776607e37302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:26:22 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-cea06f4c-5e51-4f45-a29b-53144ce8b2ff tempest-VolumesListAdminTestJSON-1495754003 None] Created volume successfully. Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Flow 'volume_create_manager' (1e2bfc07-4860-433d-a8ea-4e1be4b6610c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1d69b6-f33f-483c-ae46-e1713e16fd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1d69b6-f33f-483c-ae46-e1713e16fd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-408488918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec91fca89624aa9a9686cab49101bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:26:24Z,use_quota=True,user_id='30716137b7304f51be34cd3ab6a01328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103acb7b-5663-4a52-8438-45e011c63d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103acb7b-5663-4a52-8438-45e011c63d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b092438-3766-459e-983d-242ab9f3b5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b092438-3766-459e-983d-242ab9f3b5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf', 'volume_name': 'volume-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488b1958-8107-476d-9176-dd8a7953ef67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488b1958-8107-476d-9176-dd8a7953ef67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92acb63-f07c-44f7-981a-5e6f9a091839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:23 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Volume 6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf', 'volume_size': 1} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-408488918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec91fca89624aa9a9686cab49101bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:26:24Z,use_quota=True,user_id='30716137b7304f51be34cd3ab6a01328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Creating volume 6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:26:23 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:26:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:23 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf 1073741824 Sep 10 18:26:23 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:24 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf 1073741824" returned: 0 in 0.538s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:24 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf Sep 10 18:26:24 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:24 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf" returned: 0 in 0.294s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:24 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:26:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92acb63-f07c-44f7-981a-5e6f9a091839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d90164-806b-4bad-abc5-5a3750399fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:24 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Volume volume-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf (6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf): created successfully Sep 10 18:26:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d90164-806b-4bad-abc5-5a3750399fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Flow 'volume_create_manager' (1e2bfc07-4860-433d-a8ea-4e1be4b6610c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:26:24 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-49c2b444-e92f-494c-859a-6b88fc969f46 tempest-VolumesListAdminTestJSON-1495754003 None] Created volume successfully. Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Flow 'volume_create_manager' (f5455efd-f73f-44e9-be37-83a363b00186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62a3350-3158-4a18-b222-95ae822655e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62a3350-3158-4a18-b222-95ae822655e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-94258532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86b20b8c-cf8d-4e94-9a4d-7360a08de81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec91fca89624aa9a9686cab49101bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:26:27Z,use_quota=True,user_id='30716137b7304f51be34cd3ab6a01328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9be021-8503-49e0-af50-6c9ff72c392b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9be021-8503-49e0-af50-6c9ff72c392b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4f5b33-b4c6-42cd-8889-0991953a0b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4f5b33-b4c6-42cd-8889-0991953a0b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86b20b8c-cf8d-4e94-9a4d-7360a08de81e', 'volume_name': 'volume-86b20b8c-cf8d-4e94-9a4d-7360a08de81e', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36be1f68-eae7-4538-9b61-891439b5623d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36be1f68-eae7-4538-9b61-891439b5623d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877ca4d2-a55d-4336-8a61-4e97cb1c9e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:27 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Volume 86b20b8c-cf8d-4e94-9a4d-7360a08de81e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86b20b8c-cf8d-4e94-9a4d-7360a08de81e', 'volume_size': 1} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-94258532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86b20b8c-cf8d-4e94-9a4d-7360a08de81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec91fca89624aa9a9686cab49101bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:26:27Z,use_quota=True,user_id='30716137b7304f51be34cd3ab6a01328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Creating volume 86b20b8c-cf8d-4e94-9a4d-7360a08de81e {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:26:27 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b20b8c-cf8d-4e94-9a4d-7360a08de81e 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:27 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b20b8c-cf8d-4e94-9a4d-7360a08de81e 1073741824 Sep 10 18:26:27 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:27 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b20b8c-cf8d-4e94-9a4d-7360a08de81e 1073741824" returned: 0 in 0.702s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b20b8c-cf8d-4e94-9a4d-7360a08de81e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:27 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b20b8c-cf8d-4e94-9a4d-7360a08de81e Sep 10 18:26:27 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:28 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b20b8c-cf8d-4e94-9a4d-7360a08de81e" returned: 0 in 0.397s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:26:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877ca4d2-a55d-4336-8a61-4e97cb1c9e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86b20b8c-cf8d-4e94-9a4d-7360a08de81e', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfcc2e5c-7016-4b0a-832c-e3756d0fa168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:28 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Volume volume-86b20b8c-cf8d-4e94-9a4d-7360a08de81e (86b20b8c-cf8d-4e94-9a4d-7360a08de81e): created successfully Sep 10 18:26:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfcc2e5c-7016-4b0a-832c-e3756d0fa168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Flow 'volume_create_manager' (f5455efd-f73f-44e9-be37-83a363b00186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:26:28 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-333529c8-7bf8-4f9d-9a7f-84e876368318 tempest-VolumesListAdminTestJSON-1495754003 None] Created volume successfully. Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:29 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:26:29 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Flow 'volume_create_manager' (953b2a0d-4831-4921-bb37-a84b9b3b1fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1b6f45-09d9-4520-83eb-71122b24edf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=83,cinder:INSERT=25,cinder:UPDATE=84,cinder:DELETE=4 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1b6f45-09d9-4520-83eb-71122b24edf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-814140855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5bb978b-07c6-4050-9506-28bf0a8e070b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b030c335740449fda743652603e4b3d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:26:29Z,use_quota=True,user_id='cca35c23836f4fe09825585c409953c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a772429-5a9a-418b-812e-f2a654ebd7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a772429-5a9a-418b-812e-f2a654ebd7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17390d20-5f7e-4edd-95e5-164ef0a10094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17390d20-5f7e-4edd-95e5-164ef0a10094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5bb978b-07c6-4050-9506-28bf0a8e070b', 'volume_name': 'volume-f5bb978b-07c6-4050-9506-28bf0a8e070b', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59241f8-7233-4c00-bc7a-4f46b2649e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59241f8-7233-4c00-bc7a-4f46b2649e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5401fda0-e03f-47b2-b0e8-63ec54c0f1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:29 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Volume f5bb978b-07c6-4050-9506-28bf0a8e070b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5bb978b-07c6-4050-9506-28bf0a8e070b', 'volume_size': 1} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-814140855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5bb978b-07c6-4050-9506-28bf0a8e070b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b030c335740449fda743652603e4b3d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:26:29Z,use_quota=True,user_id='cca35c23836f4fe09825585c409953c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Creating volume f5bb978b-07c6-4050-9506-28bf0a8e070b {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:26:29 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f5bb978b-07c6-4050-9506-28bf0a8e070b 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:29 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f5bb978b-07c6-4050-9506-28bf0a8e070b 1073741824 Sep 10 18:26:29 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:29 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.501s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 28 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:26:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:26:30 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f5bb978b-07c6-4050-9506-28bf0a8e070b 1073741824" returned: 0 in 0.647s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:UPDATE=77,cinder:SELECT=73,cinder:INSERT=17,cinder:DELETE=8 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f5bb978b-07c6-4050-9506-28bf0a8e070b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:30 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f5bb978b-07c6-4050-9506-28bf0a8e070b Sep 10 18:26:30 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:30 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f5bb978b-07c6-4050-9506-28bf0a8e070b" returned: 0 in 0.399s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5401fda0-e03f-47b2-b0e8-63ec54c0f1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5bb978b-07c6-4050-9506-28bf0a8e070b', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bab1db1-5ce7-4381-a9f5-cc7444d7eb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:30 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Volume volume-f5bb978b-07c6-4050-9506-28bf0a8e070b (f5bb978b-07c6-4050-9506-28bf0a8e070b): created successfully Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bab1db1-5ce7-4381-a9f5-cc7444d7eb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Flow 'volume_create_manager' (953b2a0d-4831-4921-bb37-a84b9b3b1fd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:26:30 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-7a067784-4182-49d8-bb99-3c2b8de3caeb tempest-AttachVolumeShelveTestJSON-1909036614 None] Created volume successfully. Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Flow 'volume_create_manager' (7b1fbccf-42c5-487f-8b23-42d8803245e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a62fd1-6ee3-4ea5-89fd-7b70c6ded54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a62fd1-6ee3-4ea5-89fd-7b70c6ded54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=741b70af-8dcc-4046-af30-b552ca5aad17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='251ee3751a0e48739e316bf095b2f176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:26:31Z,use_quota=True,user_id='79089a142406418da16df99c15acd36f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba51c04-3b3a-4a23-84bc-9e8c9c859d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba51c04-3b3a-4a23-84bc-9e8c9c859d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5323ecdc-5075-4683-ab73-dfcdf11433f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5323ecdc-5075-4683-ab73-dfcdf11433f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '741b70af-8dcc-4046-af30-b552ca5aad17', 'volume_name': 'volume-741b70af-8dcc-4046-af30-b552ca5aad17', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a813fb69-2117-47aa-ab3b-8cbba08ba926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a813fb69-2117-47aa-ab3b-8cbba08ba926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a352194-3ff0-40c2-a72a-f7cbc35c95ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:30 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Volume 741b70af-8dcc-4046-af30-b552ca5aad17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-741b70af-8dcc-4046-af30-b552ca5aad17', 'volume_size': 1} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=741b70af-8dcc-4046-af30-b552ca5aad17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='251ee3751a0e48739e316bf095b2f176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:26:31Z,use_quota=True,user_id='79089a142406418da16df99c15acd36f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Creating volume 741b70af-8dcc-4046-af30-b552ca5aad17 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:26:30 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:26:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-741b70af-8dcc-4046-af30-b552ca5aad17 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:30 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-741b70af-8dcc-4046-af30-b552ca5aad17 1073741824 Sep 10 18:26:30 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:31 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-741b70af-8dcc-4046-af30-b552ca5aad17 1073741824" returned: 0 in 0.460s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-741b70af-8dcc-4046-af30-b552ca5aad17 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:31 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-741b70af-8dcc-4046-af30-b552ca5aad17 Sep 10 18:26:31 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:31 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-741b70af-8dcc-4046-af30-b552ca5aad17" returned: 0 in 0.319s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:31 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:26:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:31 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a352194-3ff0-40c2-a72a-f7cbc35c95ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-741b70af-8dcc-4046-af30-b552ca5aad17', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:31 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bc275e7-cbc0-4ab6-9f63-bfa21af59773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:31 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Volume volume-741b70af-8dcc-4046-af30-b552ca5aad17 (741b70af-8dcc-4046-af30-b552ca5aad17): created successfully Sep 10 18:26:31 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bc275e7-cbc0-4ab6-9f63-bfa21af59773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:31 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Flow 'volume_create_manager' (7b1fbccf-42c5-487f-8b23-42d8803245e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:26:31 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-084b1e67-a7e3-4da4-8e6e-4460f3a04d0f tempest-VolumesListAdminTestJSON-2101114532 None] Created volume successfully. Sep 10 18:26:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] Acquiring lock "cinder-741b70af-8dcc-4046-af30-b552ca5aad17-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:26:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] Lock "cinder-741b70af-8dcc-4046-af30-b552ca5aad17-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:26:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] Acquiring lock "cinder-quobyte-741b70af-8dcc-4046-af30-b552ca5aad17" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:26:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] Lock "cinder-quobyte-741b70af-8dcc-4046-af30-b552ca5aad17" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:26:33 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6e7fb3-8e02-41df-a126-21a57c12f0bd]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:26:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-741b70af-8dcc-4046-af30-b552ca5aad17 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] Acquiring lock "cinder-86b20b8c-cf8d-4e94-9a4d-7360a08de81e-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:26:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "cinder-86b20b8c-cf8d-4e94-9a4d-7360a08de81e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:26:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] Acquiring lock "cinder-quobyte-86b20b8c-cf8d-4e94-9a4d-7360a08de81e" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:26:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "cinder-quobyte-86b20b8c-cf8d-4e94-9a4d-7360a08de81e" acquired by "delete_volume" :: waited 0.035s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:26:33 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0c1ad3-2e53-44c7-ab65-e546bfc689df]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:26:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b20b8c-cf8d-4e94-9a4d-7360a08de81e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:33 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-741b70af-8dcc-4046-af30-b552ca5aad17 Sep 10 18:26:33 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:33 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b20b8c-cf8d-4e94-9a4d-7360a08de81e Sep 10 18:26:33 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:33 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-741b70af-8dcc-4046-af30-b552ca5aad17" returned: 0 in 0.576s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-741b70af-8dcc-4046-af30-b552ca5aad17 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:33 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-741b70af-8dcc-4046-af30-b552ca5aad17 Sep 10 18:26:33 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:33 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b20b8c-cf8d-4e94-9a4d-7360a08de81e" returned: 0 in 0.679s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b20b8c-cf8d-4e94-9a4d-7360a08de81e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:34 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b20b8c-cf8d-4e94-9a4d-7360a08de81e Sep 10 18:26:34 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:34 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-741b70af-8dcc-4046-af30-b552ca5aad17" returned: 0 in 0.404s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] Lock "cinder-quobyte-741b70af-8dcc-4046-af30-b552ca5aad17" released by "delete_volume" :: held 1.038s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] Created reservations ['94583930-03f2-43fa-82a3-da9c52a85098', '2fb76083-c96b-4631-820c-f9e491e92c85', 'e7d7222c-2606-4cb2-9aa3-b214639bae57', '733606df-b0f7-40bf-a13a-cd38f392a609'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:34 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:26:34 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:34 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-86b20b8c-cf8d-4e94-9a4d-7360a08de81e" returned: 0 in 0.486s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "cinder-quobyte-86b20b8c-cf8d-4e94-9a4d-7360a08de81e" released by "delete_volume" :: held 1.260s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:26:34 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.340s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:26:34 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] Deleted volume successfully. Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] Created reservations ['c301d2f1-8661-408c-9934-dbbe9a046199', 'e4ab0bde-1a62-4a1c-a21a-61807203219c', 'ad289fa0-b31f-4ed0-a6d9-a512b8c27474', 'b38db346-d4de-4684-9fe4-d5a260940ac2'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dbae01ad-03de-4486-a9ca-7824dafc7f5e tempest-VolumesListAdminTestJSON-2101114532 None] Lock "cinder-741b70af-8dcc-4046-af30-b552ca5aad17-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:34 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:26:34 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:35 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.470s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:35 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:26:35 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] Deleted volume successfully. Sep 10 18:26:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1508f2a0-d2df-4f75-8edd-97856a1132a7 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "cinder-86b20b8c-cf8d-4e94-9a4d-7360a08de81e-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:26:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] Acquiring lock "cinder-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:26:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "cinder-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:26:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] Acquiring lock "cinder-quobyte-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:26:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "cinder-quobyte-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf" acquired by "delete_volume" :: waited 0.047s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:26:35 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[701d8da4-c497-4104-b6ea-0eb7499784b1]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:26:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:35 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf Sep 10 18:26:35 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:36 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf" returned: 0 in 0.566s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:36 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf Sep 10 18:26:36 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:36 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf" returned: 0 in 0.426s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "cinder-quobyte-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf" released by "delete_volume" :: held 1.068s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:26:36 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] Created reservations ['6ac60614-0563-48b6-8128-0b5c8749205d', 'ef77bf62-9c4f-49a5-9a97-b1a425e96e1e', 'ffad4bd8-b8ec-49b9-8aef-c8bfa2e38ecc', '174e937c-7acb-40be-9251-2eaa2d4474d5'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:26:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:26:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:26:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:37 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:26:37 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:37 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.320s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:37 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:26:37 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] Deleted volume successfully. Sep 10 18:26:37 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7834a351-9061-4f25-87ac-c08c13f4cf41 tempest-VolumesListAdminTestJSON-1495754003 None] Lock "cinder-6cd46c76-c0dd-46a6-bdd1-58d4bfd3adbf-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:26:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] Acquiring lock "cinder-463e4b98-a37f-4347-a2b9-6f13b72ae5f3-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:26:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] Lock "cinder-463e4b98-a37f-4347-a2b9-6f13b72ae5f3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:26:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] Acquiring lock "cinder-quobyte-463e4b98-a37f-4347-a2b9-6f13b72ae5f3" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:26:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] Lock "cinder-quobyte-463e4b98-a37f-4347-a2b9-6f13b72ae5f3" acquired by "delete_volume" :: waited 0.028s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:26:38 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e652e0-4ac8-484c-bc65-3c7ac14a170d]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:26:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-463e4b98-a37f-4347-a2b9-6f13b72ae5f3 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:38 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-463e4b98-a37f-4347-a2b9-6f13b72ae5f3 Sep 10 18:26:38 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:38 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-463e4b98-a37f-4347-a2b9-6f13b72ae5f3" returned: 0 in 0.666s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-463e4b98-a37f-4347-a2b9-6f13b72ae5f3 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:39 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-463e4b98-a37f-4347-a2b9-6f13b72ae5f3 Sep 10 18:26:39 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:39 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-463e4b98-a37f-4347-a2b9-6f13b72ae5f3" returned: 0 in 0.373s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:39 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] Lock "cinder-quobyte-463e4b98-a37f-4347-a2b9-6f13b72ae5f3" released by "delete_volume" :: held 1.112s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:26:39 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] Created reservations ['6177e29a-fcf8-4c26-b515-9f8d13fbba4b', '3dd373ec-19f6-45d7-8a13-19728b19b39b', '9c000bcb-2cd0-4529-b40d-ae2e565c82e6', 'e23edcee-b40e-4f36-a412-3c09fac2c1e9'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:26:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:39 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:26:39 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:26:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:39 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:26:39 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:39 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.329s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:39 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:26:39 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] Deleted volume successfully. Sep 10 18:26:39 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-04767fd6-3cd7-4c6e-b78b-b4c9d1f84a2b tempest-VolumesListAdminTestJSON-1495754003 None] Lock "cinder-463e4b98-a37f-4347-a2b9-6f13b72ae5f3-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:26:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-6801c8a9-701e-409b-8d45-f63a43097b62 req-5f3d1199-51f3-483a-944f-bc685bf6ba63 tempest-AttachVolumeShelveTestJSON-1909036614 None] No connector for attachment c0c23eba-a6a3-4f32-9749-c4a04f7d0f79; skipping storage backend terminate_connection call. {{(pid=87842) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 10 18:26:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-6801c8a9-701e-409b-8d45-f63a43097b62 req-5f3d1199-51f3-483a-944f-bc685bf6ba63 tempest-AttachVolumeShelveTestJSON-1909036614 None] Deleting attachment c0c23eba-a6a3-4f32-9749-c4a04f7d0f79. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Flow 'volume_create_manager' (b62a29b7-b921-40ec-bca6-b535b75b34eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88bb789e-8326-4186-ae49-77689f6eebd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88bb789e-8326-4186-ae49-77689f6eebd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-172357881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48939293-6b80-4228-bfd1-adb0a72d4fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c8b4c1bf99947e1829af13eba2d7ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:26:48Z,use_quota=True,user_id='2f2ebd8cef524a4bbcad7f7853aabf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55eb7e1e-edd8-4ad2-b162-6e601351714c),volume_type_id=55eb7e1e-edd8-4ad2-b162-6e601351714c)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb915b99-2879-4e0b-ac5a-98395088e989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb915b99-2879-4e0b-ac5a-98395088e989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744c36eb-4fbf-44e5-a327-7b04ef403888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744c36eb-4fbf-44e5-a327-7b04ef403888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48939293-6b80-4228-bfd1-adb0a72d4fd2', 'volume_name': 'volume-48939293-6b80-4228-bfd1-adb0a72d4fd2', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a6b075-a1a4-4470-902e-f6146bd614f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a6b075-a1a4-4470-902e-f6146bd614f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5494f4c7-f927-4ae5-9c81-4beb24805810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:48 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Volume 48939293-6b80-4228-bfd1-adb0a72d4fd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48939293-6b80-4228-bfd1-adb0a72d4fd2', 'volume_size': 1} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-172357881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48939293-6b80-4228-bfd1-adb0a72d4fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c8b4c1bf99947e1829af13eba2d7ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:26:48Z,use_quota=True,user_id='2f2ebd8cef524a4bbcad7f7853aabf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55eb7e1e-edd8-4ad2-b162-6e601351714c),volume_type_id=55eb7e1e-edd8-4ad2-b162-6e601351714c)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Creating volume 48939293-6b80-4228-bfd1-adb0a72d4fd2 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:26:48 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:26:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-48939293-6b80-4228-bfd1-adb0a72d4fd2 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:48 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-48939293-6b80-4228-bfd1-adb0a72d4fd2 1073741824 Sep 10 18:26:48 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:49 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:26:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Flow 'volume_create_manager' (d2a003dc-5ffa-4afb-ab2d-81b051d50b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:26:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d867957-470d-4207-a3e7-7dee12306742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d867957-470d-4207-a3e7-7dee12306742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-43649540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c8b4c1bf99947e1829af13eba2d7ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:26:49Z,use_quota=True,user_id='2f2ebd8cef524a4bbcad7f7853aabf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a1fac4b-dc75-4a50-960a-dd0af289b957),volume_type_id=3a1fac4b-dc75-4a50-960a-dd0af289b957)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158649f1-c763-497c-ac2e-2944dc12041f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158649f1-c763-497c-ac2e-2944dc12041f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e34fba82-5ba9-432d-8511-961c167b3854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e34fba82-5ba9-432d-8511-961c167b3854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64', 'volume_name': 'volume-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ad676e-b988-4359-ac78-10be37fe4bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:49 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ad676e-b988-4359-ac78-10be37fe4bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9591d03-61e2-4857-88ec-0edd3d876491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:49 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Volume 9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64', 'volume_size': 1} Sep 10 18:26:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-48939293-6b80-4228-bfd1-adb0a72d4fd2 1073741824" returned: 0 in 1.216s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-48939293-6b80-4228-bfd1-adb0a72d4fd2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:49 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-48939293-6b80-4228-bfd1-adb0a72d4fd2 Sep 10 18:26:49 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:50 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-48939293-6b80-4228-bfd1-adb0a72d4fd2" returned: 0 in 0.568s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.637s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-43649540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c8b4c1bf99947e1829af13eba2d7ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:26:49Z,use_quota=True,user_id='2f2ebd8cef524a4bbcad7f7853aabf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a1fac4b-dc75-4a50-960a-dd0af289b957),volume_type_id=3a1fac4b-dc75-4a50-960a-dd0af289b957)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Creating volume 9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:26:50 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5494f4c7-f927-4ae5-9c81-4beb24805810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48939293-6b80-4228-bfd1-adb0a72d4fd2', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed018533-32ba-4256-857d-962d5d5d3561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:50 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64 1073741824 Sep 10 18:26:50 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:50 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Volume volume-48939293-6b80-4228-bfd1-adb0a72d4fd2 (48939293-6b80-4228-bfd1-adb0a72d4fd2): created successfully Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed018533-32ba-4256-857d-962d5d5d3561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Flow 'volume_create_manager' (b62a29b7-b921-40ec-bca6-b535b75b34eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:26:50 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-584c009f-7df5-410d-b2a8-3874e72c6e9b tempest-TestInstancesWithCinderVolumes-1476110052 None] Created volume successfully. Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Flow 'volume_create_manager' (db247ac8-45d8-499b-898f-c72cae521f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0488ce3-b857-4085-aa4e-27b9829cfed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0488ce3-b857-4085-aa4e-27b9829cfed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2048551296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9813e20-a161-4d18-ba03-3c758585eb6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c8b4c1bf99947e1829af13eba2d7ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:26:50Z,use_quota=True,user_id='2f2ebd8cef524a4bbcad7f7853aabf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb18e944-dccf-4e6c-a073-e8b7f2d2dbd6),volume_type_id=cb18e944-dccf-4e6c-a073-e8b7f2d2dbd6)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b2adc2-2fc9-44ca-b7ea-108690f84ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b2adc2-2fc9-44ca-b7ea-108690f84ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502c7745-88a2-46a3-b60b-320ccea5af09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG cinder.image.glance [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Creating Keystone auth plugin from conf {{(pid=87842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 18:26:50 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64 1073741824" returned: 0 in 0.685s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:50 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64 Sep 10 18:26:50 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:51 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64" returned: 0 in 0.545s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9591d03-61e2-4857-88ec-0edd3d876491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b9df18-23a2-437f-8998-87565beba869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:51 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Volume volume-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64 (9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64): created successfully Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b9df18-23a2-437f-8998-87565beba869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Flow 'volume_create_manager' (d2a003dc-5ffa-4afb-ab2d-81b051d50b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:26:51 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-a72be0a5-0196-4957-a13e-be3a81efe204 tempest-TestInstancesWithCinderVolumes-1476110052 None] Created volume successfully. Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502c7745-88a2-46a3-b60b-320ccea5af09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a9813e20-a161-4d18-ba03-3c758585eb6b', 'volume_name': 'volume-a9813e20-a161-4d18-ba03-3c758585eb6b', 'volume_size': 1, 'image_id': 'c328f75c-eb72-457b-836d-6945f26a63eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c328f75c-eb72-457b-836d-6945f26a63eb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2131447693', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c8b4c1bf99947e1829af13eba2d7ecb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c328f75c-eb72-457b-836d-6945f26a63eb', 'created_at': datetime.datetime(2026, 9, 10, 16, 26, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 26, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c328f75c-eb72-457b-836d-6945f26a63eb/file', 'properties': {}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b49e4a-15e6-4d00-8dce-7755e2732e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b49e4a-15e6-4d00-8dce-7755e2732e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c02f233-a7b4-4259-a008-e8138c5c1a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:51 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Volume a9813e20-a161-4d18-ba03-3c758585eb6b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a9813e20-a161-4d18-ba03-3c758585eb6b', 'volume_size': 1, 'image_id': 'c328f75c-eb72-457b-836d-6945f26a63eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c328f75c-eb72-457b-836d-6945f26a63eb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2131447693', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c8b4c1bf99947e1829af13eba2d7ecb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c328f75c-eb72-457b-836d-6945f26a63eb', 'created_at': datetime.datetime(2026, 9, 10, 16, 26, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 26, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c328f75c-eb72-457b-836d-6945f26a63eb/file', 'properties': {}}, 'image_service': } Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Trying to clone a9813e20-a161-4d18-ba03-3c758585eb6b from image c328f75c-eb72-457b-836d-6945f26a63eb at location (None, [{'url': 'file:///opt/stack/data/glance/images/c328f75c-eb72-457b-836d-6945f26a63eb', 'metadata': {}}]). {{(pid=87842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Flow 'volume_create_manager' (f8892ec8-4265-4087-be8a-b3a58a42fa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c05123e-e1c2-444c-8711-b43f52e23304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c05123e-e1c2-444c-8711-b43f52e23304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-608420834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94630a5c-c2ac-4125-a975-d354d9d318f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1fd48b915c34b81bddf488a36acf566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:26:52Z,use_quota=True,user_id='ca31e259b26443d6ac3325fdb0079a8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a58de4-41e2-4fef-9196-8ba37fa98d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a58de4-41e2-4fef-9196-8ba37fa98d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f52fdc4-798b-40b2-a612-3beefac5583f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f52fdc4-798b-40b2-a612-3beefac5583f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94630a5c-c2ac-4125-a975-d354d9d318f4', 'volume_name': 'volume-94630a5c-c2ac-4125-a975-d354d9d318f4', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f3f468-407f-4fff-869c-b973309be736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f3f468-407f-4fff-869c-b973309be736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5005831d-30ee-4679-8e8d-60644da5a2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:51 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Volume 94630a5c-c2ac-4125-a975-d354d9d318f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94630a5c-c2ac-4125-a975-d354d9d318f4', 'volume_size': 1} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-608420834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94630a5c-c2ac-4125-a975-d354d9d318f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1fd48b915c34b81bddf488a36acf566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:26:52Z,use_quota=True,user_id='ca31e259b26443d6ac3325fdb0079a8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Creating volume 94630a5c-c2ac-4125-a975-d354d9d318f4 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:26:51 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:26:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:51 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4 1073741824 Sep 10 18:26:51 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:52 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4 1073741824" returned: 0 in 0.833s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:52 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4 Sep 10 18:26:52 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:53 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4" returned: 0 in 0.313s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:26:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5005831d-30ee-4679-8e8d-60644da5a2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94630a5c-c2ac-4125-a975-d354d9d318f4', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed213ce7-5cbb-4ea3-a134-28a67d99ce28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:26:53 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Volume volume-94630a5c-c2ac-4125-a975-d354d9d318f4 (94630a5c-c2ac-4125-a975-d354d9d318f4): created successfully Sep 10 18:26:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed213ce7-5cbb-4ea3-a134-28a67d99ce28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:26:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Flow 'volume_create_manager' (f8892ec8-4265-4087-be8a-b3a58a42fa33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:26:53 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-aaf200c9-0dae-47f2-9dc5-f6e6e93a8b96 tempest-SnapshotMetadataTestJSON-1098585781 None] Created volume successfully. Sep 10 18:26:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6388bbf8-70d5-404a-9f4d-3caa26152bd1 tempest-SnapshotMetadataTestJSON-1098585781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6388bbf8-70d5-404a-9f4d-3caa26152bd1 tempest-SnapshotMetadataTestJSON-1098585781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-6388bbf8-70d5-404a-9f4d-3caa26152bd1 tempest-SnapshotMetadataTestJSON-1098585781 None] Creating offline snapshot e37c358e-306d-4ca9-a329-96d730d88384 of volume 94630a5c-c2ac-4125-a975-d354d9d318f4 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:26:54 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a586a18-96c6-4a06-880e-8faee6d3d321]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:26:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6388bbf8-70d5-404a-9f4d-3caa26152bd1 tempest-SnapshotMetadataTestJSON-1098585781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:54 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4 Sep 10 18:26:54 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:54 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6388bbf8-70d5-404a-9f4d-3caa26152bd1 tempest-SnapshotMetadataTestJSON-1098585781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4" returned: 0 in 0.529s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6388bbf8-70d5-404a-9f4d-3caa26152bd1 tempest-SnapshotMetadataTestJSON-1098585781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:54 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384 1G Sep 10 18:26:54 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:55 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6388bbf8-70d5-404a-9f4d-3caa26152bd1 tempest-SnapshotMetadataTestJSON-1098585781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384 1G" returned: 0 in 0.899s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6388bbf8-70d5-404a-9f4d-3caa26152bd1 tempest-SnapshotMetadataTestJSON-1098585781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94630a5c-c2ac-4125-a975-d354d9d318f4 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:55 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94630a5c-c2ac-4125-a975-d354d9d318f4 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384 Sep 10 18:26:55 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:56 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:56 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c328f75c-eb72-457b-836d-6945f26a63eb_iljuoxexdevstack@QuobyteHD, size 20.69 MB, duration 4.55 sec {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 18:26:56 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Image download 20.69 MB at 4.55 MB/s Sep 10 18:26:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6388bbf8-70d5-404a-9f4d-3caa26152bd1 tempest-SnapshotMetadataTestJSON-1098585781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94630a5c-c2ac-4125-a975-d354d9d318f4 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384" returned: 0 in 0.532s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:56 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-6388bbf8-70d5-404a-9f4d-3caa26152bd1 tempest-SnapshotMetadataTestJSON-1098585781 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384 is being set with open permissions: ugo+rw Sep 10 18:26:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6388bbf8-70d5-404a-9f4d-3caa26152bd1 tempest-SnapshotMetadataTestJSON-1098585781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:56 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384 Sep 10 18:26:56 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:56 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b698ff89-de97-422d-a420-fc3f76bb81c9]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:26:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c328f75c-eb72-457b-836d-6945f26a63eb_iljuoxexdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:56 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c328f75c-eb72-457b-836d-6945f26a63eb_iljuoxexdevstack@QuobyteHD Sep 10 18:26:56 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:56 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6388bbf8-70d5-404a-9f4d-3caa26152bd1 tempest-SnapshotMetadataTestJSON-1098585781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384" returned: 0 in 0.377s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6388bbf8-70d5-404a-9f4d-3caa26152bd1 tempest-SnapshotMetadataTestJSON-1098585781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:56 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.info Sep 10 18:26:56 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:56 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c328f75c-eb72-457b-836d-6945f26a63eb_iljuoxexdevstack@QuobyteHD" returned: 0 in 0.500s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:56 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Temporary image c328f75c-eb72-457b-836d-6945f26a63eb is fetched for user 2f2ebd8cef524a4bbcad7f7853aabf37. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 18:26:57 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6388bbf8-70d5-404a-9f4d-3caa26152bd1 tempest-SnapshotMetadataTestJSON-1098585781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.info" returned: 0 in 0.405s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:57 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-6388bbf8-70d5-404a-9f4d-3caa26152bd1 tempest-SnapshotMetadataTestJSON-1098585781 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.info is being set with open permissions: ugo+rw Sep 10 18:26:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6388bbf8-70d5-404a-9f4d-3caa26152bd1 tempest-SnapshotMetadataTestJSON-1098585781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:57 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecb1df3-7665-4827-a1c3-24ab832d91ab]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:26:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c328f75c-eb72-457b-836d-6945f26a63eb_iljuoxexdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:57 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.info Sep 10 18:26:57 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:57 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c328f75c-eb72-457b-836d-6945f26a63eb_iljuoxexdevstack@QuobyteHD Sep 10 18:26:57 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:57 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6388bbf8-70d5-404a-9f4d-3caa26152bd1 tempest-SnapshotMetadataTestJSON-1098585781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.info" returned: 0 in 0.396s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:57 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6388bbf8-70d5-404a-9f4d-3caa26152bd1 tempest-SnapshotMetadataTestJSON-1098585781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.321s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c328f75c-eb72-457b-836d-6945f26a63eb_iljuoxexdevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2048551296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9813e20-a161-4d18-ba03-3c758585eb6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c8b4c1bf99947e1829af13eba2d7ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:26:50Z,use_quota=True,user_id='2f2ebd8cef524a4bbcad7f7853aabf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb18e944-dccf-4e6c-a073-e8b7f2d2dbd6),volume_type_id=cb18e944-dccf-4e6c-a073-e8b7f2d2dbd6)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:26:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Creating volume a9813e20-a161-4d18-ba03-3c758585eb6b {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:26:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:26:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:26:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:26:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:26:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:26:57 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:26:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9813e20-a161-4d18-ba03-3c758585eb6b 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:57 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9813e20-a161-4d18-ba03-3c758585eb6b 1073741824 Sep 10 18:26:57 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:57 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-6388bbf8-70d5-404a-9f4d-3caa26152bd1 tempest-SnapshotMetadataTestJSON-1098585781 None] Create snapshot completed successfully Sep 10 18:26:58 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9813e20-a161-4d18-ba03-3c758585eb6b 1073741824" returned: 0 in 0.444s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9813e20-a161-4d18-ba03-3c758585eb6b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:58 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9813e20-a161-4d18-ba03-3c758585eb6b Sep 10 18:26:58 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:58 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9813e20-a161-4d18-ba03-3c758585eb6b" returned: 0 in 0.256s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:26:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:26:58 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Attempting download of c328f75c-eb72-457b-836d-6945f26a63eb ((None, [{'url': 'file:///opt/stack/data/glance/images/c328f75c-eb72-457b-836d-6945f26a63eb', 'metadata': {}}])) to volume a9813e20-a161-4d18-ba03-3c758585eb6b. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 18:26:58 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9651a5db-3a74-4757-9f55-ba25a539b039]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:26:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c328f75c-eb72-457b-836d-6945f26a63eb_ir5061tr {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:58 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c328f75c-eb72-457b-836d-6945f26a63eb_ir5061tr Sep 10 18:26:58 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:58 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c328f75c-eb72-457b-836d-6945f26a63eb_ir5061tr" returned: 0 in 0.444s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c328f75c-eb72-457b-836d-6945f26a63eb_ir5061tr {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:59 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c328f75c-eb72-457b-836d-6945f26a63eb_ir5061tr Sep 10 18:26:59 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:59 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c328f75c-eb72-457b-836d-6945f26a63eb_ir5061tr" returned: 1 in 0.428s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c328f75c-eb72-457b-836d-6945f26a63eb_ir5061tr' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:26:59 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ca943b-94d3-428b-8f3f-b20f4d2ea9b2]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:26:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c328f75c-eb72-457b-836d-6945f26a63eb_iljuoxexdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:59 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c328f75c-eb72-457b-836d-6945f26a63eb_iljuoxexdevstack@QuobyteHD Sep 10 18:26:59 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] Acquiring lock "cinder-e37c358e-306d-4ca9-a329-96d730d88384-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:26:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] Lock "cinder-e37c358e-306d-4ca9-a329-96d730d88384-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:26:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] Acquiring lock "cinder-quobyte-94630a5c-c2ac-4125-a975-d354d9d318f4" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:26:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] Lock "cinder-quobyte-94630a5c-c2ac-4125-a975-d354d9d318f4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:26:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] Acquiring lock "cinder-quobyte-e37c358e-306d-4ca9-a329-96d730d88384" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:26:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] Lock "cinder-quobyte-e37c358e-306d-4ca9-a329-96d730d88384" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:26:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] Deleting offline snapshot e37c358e-306d-4ca9-a329-96d730d88384 of volume 94630a5c-c2ac-4125-a975-d354d9d318f4 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:26:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] snapshot_file for this snap is: volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:26:59 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48088cf-e3c4-460f-96b1-c3ffa95bb9a8]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:26:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:59 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Sep 10 18:26:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c328f75c-eb72-457b-836d-6945f26a63eb_iljuoxexdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:26:59 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] c328f75c-eb72-457b-836d-6945f26a63eb was qcow2, converting to qcow2 {{(pid=87842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 18:26:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c328f75c-eb72-457b-836d-6945f26a63eb_iljuoxexdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9813e20-a161-4d18-ba03-3c758585eb6b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:26:59 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c328f75c-eb72-457b-836d-6945f26a63eb_iljuoxexdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9813e20-a161-4d18-ba03-3c758585eb6b Sep 10 18:26:59 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:26:59 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384 Sep 10 18:26:59 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:00 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384" returned: 0 in 0.402s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:00 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94630a5c-c2ac-4125-a975-d354d9d318f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:27:00 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b2e951-1524-4e9c-8a5c-a3617addf1f2]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:00 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4 Sep 10 18:27:00 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:00 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4" returned: 0 in 0.400s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:00 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384 Sep 10 18:27:00 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:00 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384" returned: 0 in 0.548s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:01 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384 Sep 10 18:27:01 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:01 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4.e37c358e-306d-4ca9-a329-96d730d88384" returned: 0 in 0.455s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] Lock "cinder-quobyte-e37c358e-306d-4ca9-a329-96d730d88384" released by "_delete_snapshot" :: held 1.941s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] Lock "cinder-quobyte-94630a5c-c2ac-4125-a975-d354d9d318f4" released by "delete_snapshot" :: held 1.972s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:01 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] Created reservations ['33055749-cece-4c9c-83fc-7c7190a17ecf', 'ed764fe6-6e34-4424-9097-83493b164d07', '74245763-faa7-4af4-827d-d8bf7ad4939b', 'f862ca60-5113-42a6-bbdb-813ef848f87a'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:27:01 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] Delete snapshot completed successfully. Sep 10 18:27:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-282ac05a-febf-4a03-81c4-23949eb7e717 tempest-SnapshotMetadataTestJSON-1098585781 None] Lock "cinder-e37c358e-306d-4ca9-a329-96d730d88384-delete_snapshot" released by "delete_snapshot" :: held 2.230s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:02 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c328f75c-eb72-457b-836d-6945f26a63eb_iljuoxexdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9813e20-a161-4d18-ba03-3c758585eb6b" returned: 0 in 2.460s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:02 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c328f75c-eb72-457b-836d-6945f26a63eb_iljuoxexdevstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9813e20-a161-4d18-ba03-3c758585eb6b {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:27:02 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Converted 112.00 MB image at 45.51 MB/s Sep 10 18:27:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9813e20-a161-4d18-ba03-3c758585eb6b 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:02 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9813e20-a161-4d18-ba03-3c758585eb6b 1G Sep 10 18:27:02 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:02 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9813e20-a161-4d18-ba03-3c758585eb6b 1G" returned: 0 in 0.439s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:02 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Downloaded image c328f75c-eb72-457b-836d-6945f26a63eb ((None, [{'url': 'file:///opt/stack/data/glance/images/c328f75c-eb72-457b-836d-6945f26a63eb', 'metadata': {}}])) to volume a9813e20-a161-4d18-ba03-3c758585eb6b successfully. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 18:27:02 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Temporary image c328f75c-eb72-457b-836d-6945f26a63eb for user 2f2ebd8cef524a4bbcad7f7853aabf37 is deleted. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 18:27:02 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Marking volume a9813e20-a161-4d18-ba03-3c758585eb6b as bootable. {{(pid=87842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 18:27:02 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Copying metadata from image c328f75c-eb72-457b-836d-6945f26a63eb to a9813e20-a161-4d18-ba03-3c758585eb6b. {{(pid=87842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 18:27:02 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Creating volume glance metadata for volume a9813e20-a161-4d18-ba03-3c758585eb6b backed by image c328f75c-eb72-457b-836d-6945f26a63eb with: {'image_id': 'c328f75c-eb72-457b-836d-6945f26a63eb', 'image_name': 'tempest-scenario-img--2131447693', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 18:27:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c02f233-a7b4-4259-a008-e8138c5c1a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9813e20-a161-4d18-ba03-3c758585eb6b', 'volume_size': 1, 'image_id': 'c328f75c-eb72-457b-836d-6945f26a63eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c328f75c-eb72-457b-836d-6945f26a63eb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2131447693', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c8b4c1bf99947e1829af13eba2d7ecb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c328f75c-eb72-457b-836d-6945f26a63eb', 'created_at': datetime.datetime(2026, 9, 10, 16, 26, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 26, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c328f75c-eb72-457b-836d-6945f26a63eb/file', 'properties': {}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb4a8ca-1eae-4e57-92ea-1f330eef0041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:02 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Volume volume-a9813e20-a161-4d18-ba03-3c758585eb6b (a9813e20-a161-4d18-ba03-3c758585eb6b): created successfully Sep 10 18:27:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb4a8ca-1eae-4e57-92ea-1f330eef0041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Flow 'volume_create_manager' (db247ac8-45d8-499b-898f-c72cae521f33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:27:02 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-798deadc-9f1e-4c57-b0ec-5ad909aee120 tempest-TestInstancesWithCinderVolumes-1476110052 None] Created volume successfully. Sep 10 18:27:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] Acquiring lock "cinder-94630a5c-c2ac-4125-a975-d354d9d318f4-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] Lock "cinder-94630a5c-c2ac-4125-a975-d354d9d318f4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] Acquiring lock "cinder-quobyte-94630a5c-c2ac-4125-a975-d354d9d318f4" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] Lock "cinder-quobyte-94630a5c-c2ac-4125-a975-d354d9d318f4" acquired by "delete_volume" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:03 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bb68bc-4f7e-4da1-a24d-455cac0324bd]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:03 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4 Sep 10 18:27:03 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:03 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4" returned: 0 in 0.418s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:03 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4 Sep 10 18:27:03 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:03 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-94630a5c-c2ac-4125-a975-d354d9d318f4" returned: 0 in 0.294s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] Lock "cinder-quobyte-94630a5c-c2ac-4125-a975-d354d9d318f4" released by "delete_volume" :: held 0.777s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:03 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] Created reservations ['2c9a2644-ab1f-479c-884d-7611d9c96708', '4362d4c3-dbfc-4263-acf6-ac5032ee2ab7', '0238192b-692f-4436-961f-55a1991659e7', 'f5f0091c-8550-4ad5-979a-651db5294f75'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:27:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:03 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:27:03 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:04 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.381s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:04 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:27:04 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] Deleted volume successfully. Sep 10 18:27:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4ba25106-4ce0-4334-807b-521ef8d1bea2 tempest-SnapshotMetadataTestJSON-1098585781 None] Lock "cinder-94630a5c-c2ac-4125-a975-d354d9d318f4-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-76b51933-e449-4a47-8a08-f2dcb9dafbae req-6fb5ab7a-aebc-48cc-9905-a7ef5c79c418 tempest-TestInstancesWithCinderVolumes-1476110052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-76b51933-e449-4a47-8a08-f2dcb9dafbae req-6fb5ab7a-aebc-48cc-9905-a7ef5c79c418 tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-76b51933-e449-4a47-8a08-f2dcb9dafbae req-6fb5ab7a-aebc-48cc-9905-a7ef5c79c418 tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-76b51933-e449-4a47-8a08-f2dcb9dafbae req-6fb5ab7a-aebc-48cc-9905-a7ef5c79c418 tempest-TestInstancesWithCinderVolumes-1476110052 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-a9813e20-a161-4d18-ba03-3c758585eb6b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7327e135-df1e-4b07-b0cc-977a746a9273', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:27:08 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-76b51933-e449-4a47-8a08-f2dcb9dafbae req-6fb5ab7a-aebc-48cc-9905-a7ef5c79c418 tempest-TestInstancesWithCinderVolumes-1476110052 None] attachment_update completed successfully. Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Flow 'volume_create_manager' (ce2fadd4-ed0f-4bea-9bff-60f804482587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcfa779e-5abb-4ba1-bc62-636fb3648ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcfa779e-5abb-4ba1-bc62-636fb3648ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-7068422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=291d7062-6ae2-4b26-aa68-6b6786233033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92765d6949f94886a1d1803e9637bd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:27:11Z,use_quota=True,user_id='220251de2451430b8f9b13a6715b68ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580bcf51-9920-4043-a794-13adf9163441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580bcf51-9920-4043-a794-13adf9163441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f894dd-e386-46d1-bc65-d326e79d37d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f894dd-e386-46d1-bc65-d326e79d37d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '291d7062-6ae2-4b26-aa68-6b6786233033', 'volume_name': 'volume-291d7062-6ae2-4b26-aa68-6b6786233033', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbef9046-94a0-45bb-b1a5-1e7b233fa762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbef9046-94a0-45bb-b1a5-1e7b233fa762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a407e0-ddcf-4ae0-8a87-2c2df3f32fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:11 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Volume 291d7062-6ae2-4b26-aa68-6b6786233033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-291d7062-6ae2-4b26-aa68-6b6786233033', 'volume_size': 1} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-7068422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=291d7062-6ae2-4b26-aa68-6b6786233033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92765d6949f94886a1d1803e9637bd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:27:11Z,use_quota=True,user_id='220251de2451430b8f9b13a6715b68ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Creating volume 291d7062-6ae2-4b26-aa68-6b6786233033 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:27:11 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:27:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-291d7062-6ae2-4b26-aa68-6b6786233033 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:11 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-291d7062-6ae2-4b26-aa68-6b6786233033 1073741824 Sep 10 18:27:11 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:12 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:27:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Flow 'volume_create_manager' (f04ae3f0-b802-458c-b950-d7db89eb0d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:27:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f6364e-a81b-4611-aa39-3489c0231ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f6364e-a81b-4611-aa39-3489c0231ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1727310129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc162c60-50dd-4239-883d-8fad75949ed6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213c7d02b1c641bc991d3dc3b528c5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:27:13Z,use_quota=True,user_id='37b0ea1842d54a1cb59f53a910a642b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5032b8d6-13ab-4538-a90c-d1b56f3ad666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5032b8d6-13ab-4538-a90c-d1b56f3ad666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:12 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21247b0-8b54-4bb4-90a3-efe22a7136e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21247b0-8b54-4bb4-90a3-efe22a7136e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc162c60-50dd-4239-883d-8fad75949ed6', 'volume_name': 'volume-fc162c60-50dd-4239-883d-8fad75949ed6', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac124bd-d9cf-44f4-8ac1-5a9cd747d6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac124bd-d9cf-44f4-8ac1-5a9cd747d6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a4343b6-7d93-4293-9864-480acc5e84d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:12 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Volume fc162c60-50dd-4239-883d-8fad75949ed6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc162c60-50dd-4239-883d-8fad75949ed6', 'volume_size': 1} Sep 10 18:27:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-291d7062-6ae2-4b26-aa68-6b6786233033 1073741824" returned: 0 in 0.839s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-291d7062-6ae2-4b26-aa68-6b6786233033 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:12 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-291d7062-6ae2-4b26-aa68-6b6786233033 Sep 10 18:27:12 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:13 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-291d7062-6ae2-4b26-aa68-6b6786233033" returned: 0 in 0.291s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:27:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.361s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1727310129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc162c60-50dd-4239-883d-8fad75949ed6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213c7d02b1c641bc991d3dc3b528c5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:27:13Z,use_quota=True,user_id='37b0ea1842d54a1cb59f53a910a642b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:27:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Creating volume fc162c60-50dd-4239-883d-8fad75949ed6 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:27:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:27:13 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:27:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc162c60-50dd-4239-883d-8fad75949ed6 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a407e0-ddcf-4ae0-8a87-2c2df3f32fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-291d7062-6ae2-4b26-aa68-6b6786233033', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (365f3253-1ff7-4a7d-ac17-f957d44a658f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:13 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Volume volume-291d7062-6ae2-4b26-aa68-6b6786233033 (291d7062-6ae2-4b26-aa68-6b6786233033): created successfully Sep 10 18:27:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (365f3253-1ff7-4a7d-ac17-f957d44a658f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:13 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc162c60-50dd-4239-883d-8fad75949ed6 1073741824 Sep 10 18:27:13 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Flow 'volume_create_manager' (ce2fadd4-ed0f-4bea-9bff-60f804482587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:27:13 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4bb20c8c-eb0e-4ac7-b45b-609d82a9b823 tempest-AbsoluteLimitsTests-1280132642 None] Created volume successfully. Sep 10 18:27:13 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc162c60-50dd-4239-883d-8fad75949ed6 1073741824" returned: 0 in 0.881s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc162c60-50dd-4239-883d-8fad75949ed6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:14 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc162c60-50dd-4239-883d-8fad75949ed6 Sep 10 18:27:14 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:14 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] Acquiring lock "cinder-291d7062-6ae2-4b26-aa68-6b6786233033-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:14 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] Lock "cinder-291d7062-6ae2-4b26-aa68-6b6786233033-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:14 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] Acquiring lock "cinder-quobyte-291d7062-6ae2-4b26-aa68-6b6786233033" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:14 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] Lock "cinder-quobyte-291d7062-6ae2-4b26-aa68-6b6786233033" acquired by "delete_volume" :: waited 0.018s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:14 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[82938b78-76e4-4054-8a3e-e5cf706b921b]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-291d7062-6ae2-4b26-aa68-6b6786233033 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:14 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-291d7062-6ae2-4b26-aa68-6b6786233033 Sep 10 18:27:14 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:14 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc162c60-50dd-4239-883d-8fad75949ed6" returned: 0 in 0.468s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:27:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a4343b6-7d93-4293-9864-480acc5e84d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc162c60-50dd-4239-883d-8fad75949ed6', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51838cf-a29d-42c5-a0f4-fbf61a69d1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:14 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Volume volume-fc162c60-50dd-4239-883d-8fad75949ed6 (fc162c60-50dd-4239-883d-8fad75949ed6): created successfully Sep 10 18:27:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51838cf-a29d-42c5-a0f4-fbf61a69d1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Flow 'volume_create_manager' (f04ae3f0-b802-458c-b950-d7db89eb0d83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:27:14 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f68e29c2-1850-41d7-8d17-dfda758d923d tempest-AttachVolumeTestJSON-1356128937 None] Created volume successfully. Sep 10 18:27:14 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-291d7062-6ae2-4b26-aa68-6b6786233033" returned: 0 in 0.564s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-291d7062-6ae2-4b26-aa68-6b6786233033 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:14 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-291d7062-6ae2-4b26-aa68-6b6786233033 Sep 10 18:27:14 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:15 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-291d7062-6ae2-4b26-aa68-6b6786233033" returned: 0 in 0.378s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:15 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] Lock "cinder-quobyte-291d7062-6ae2-4b26-aa68-6b6786233033" released by "delete_volume" :: held 1.004s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:15 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] Created reservations ['9970f040-68e0-4176-a806-bea018390bb1', '4b01ab90-1946-4b86-8b5d-ee963b96c80d', '1aace009-1d07-4d2c-9321-750ff9f73ab9', 'd5504c13-b712-4a92-8feb-dc9a5765007b'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:27:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:15 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:27:15 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:15 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.387s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:15 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:27:15 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] Deleted volume successfully. Sep 10 18:27:15 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-91ef02fb-6d20-483d-b9aa-08d8292ceb44 tempest-AbsoluteLimitsTests-1280132642 None] Lock "cinder-291d7062-6ae2-4b26-aa68-6b6786233033-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-fb4c7708-148a-4dda-aceb-d551a0faf493 req-4df09983-65e2-482f-8acd-1d92e5e5da62 tempest-AttachVolumeTestJSON-1356128937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-fb4c7708-148a-4dda-aceb-d551a0faf493 req-4df09983-65e2-482f-8acd-1d92e5e5da62 tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-fb4c7708-148a-4dda-aceb-d551a0faf493 req-4df09983-65e2-482f-8acd-1d92e5e5da62 tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-fb4c7708-148a-4dda-aceb-d551a0faf493 req-4df09983-65e2-482f-8acd-1d92e5e5da62 tempest-AttachVolumeTestJSON-1356128937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-fc162c60-50dd-4239-883d-8fad75949ed6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a25e68a7-f468-4070-ad6f-72e94091d1dc', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:27:16 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-fb4c7708-148a-4dda-aceb-d551a0faf493 req-4df09983-65e2-482f-8acd-1d92e5e5da62 tempest-AttachVolumeTestJSON-1356128937 None] attachment_update completed successfully. Sep 10 18:27:19 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:27:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Flow 'volume_create_manager' (8f644feb-07bf-48ed-bbd5-daa56c34f29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:27:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ca37a9-6ab5-401f-90ef-83443e48b6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ca37a9-6ab5-401f-90ef-83443e48b6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1382711612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972d85d1-a98b-4674-8a91-3b171f8c2eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213c7d02b1c641bc991d3dc3b528c5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:27:20Z,use_quota=True,user_id='37b0ea1842d54a1cb59f53a910a642b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0fc1339-617e-486c-8faf-6ad612b133b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0fc1339-617e-486c-8faf-6ad612b133b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a00b8f9-013c-4eb9-99c0-c06c57819131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a00b8f9-013c-4eb9-99c0-c06c57819131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '972d85d1-a98b-4674-8a91-3b171f8c2eb8', 'volume_name': 'volume-972d85d1-a98b-4674-8a91-3b171f8c2eb8', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6ee18d-9e1c-43e4-a38f-9c0721f6c5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6ee18d-9e1c-43e4-a38f-9c0721f6c5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (051ecb78-6825-471b-a7f3-60b7d124a47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:20 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Volume 972d85d1-a98b-4674-8a91-3b171f8c2eb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-972d85d1-a98b-4674-8a91-3b171f8c2eb8', 'volume_size': 1} Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1382711612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972d85d1-a98b-4674-8a91-3b171f8c2eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213c7d02b1c641bc991d3dc3b528c5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:27:20Z,use_quota=True,user_id='37b0ea1842d54a1cb59f53a910a642b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Creating volume 972d85d1-a98b-4674-8a91-3b171f8c2eb8 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:27:20 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-972d85d1-a98b-4674-8a91-3b171f8c2eb8 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:20 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-972d85d1-a98b-4674-8a91-3b171f8c2eb8 1073741824 Sep 10 18:27:20 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:20 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-972d85d1-a98b-4674-8a91-3b171f8c2eb8 1073741824" returned: 0 in 0.577s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-972d85d1-a98b-4674-8a91-3b171f8c2eb8 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:20 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-972d85d1-a98b-4674-8a91-3b171f8c2eb8 Sep 10 18:27:20 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:21 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-972d85d1-a98b-4674-8a91-3b171f8c2eb8" returned: 0 in 0.383s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:27:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (051ecb78-6825-471b-a7f3-60b7d124a47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-972d85d1-a98b-4674-8a91-3b171f8c2eb8', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2aeaed-69ea-484c-a8a9-47eeaf4e1968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:21 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Volume volume-972d85d1-a98b-4674-8a91-3b171f8c2eb8 (972d85d1-a98b-4674-8a91-3b171f8c2eb8): created successfully Sep 10 18:27:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2aeaed-69ea-484c-a8a9-47eeaf4e1968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Flow 'volume_create_manager' (8f644feb-07bf-48ed-bbd5-daa56c34f29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:27:21 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-9059c990-b7d6-488e-8955-648b9dbac766 tempest-AttachVolumeTestJSON-1356128937 None] Created volume successfully. Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-850e001c-d2b1-4b8c-9806-2680df5ce55b req-ce19e4e6-5a34-4f43-9f67-31307e1cb7fe tempest-AttachVolumeTestJSON-1356128937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-850e001c-d2b1-4b8c-9806-2680df5ce55b req-ce19e4e6-5a34-4f43-9f67-31307e1cb7fe tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-850e001c-d2b1-4b8c-9806-2680df5ce55b req-ce19e4e6-5a34-4f43-9f67-31307e1cb7fe tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-850e001c-d2b1-4b8c-9806-2680df5ce55b req-ce19e4e6-5a34-4f43-9f67-31307e1cb7fe tempest-AttachVolumeTestJSON-1356128937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-972d85d1-a98b-4674-8a91-3b171f8c2eb8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e51b821-f938-48b5-9012-af6d5485d988', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:27:23 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-850e001c-d2b1-4b8c-9806-2680df5ce55b req-ce19e4e6-5a34-4f43-9f67-31307e1cb7fe tempest-AttachVolumeTestJSON-1356128937 None] attachment_update completed successfully. Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Flow 'volume_create_manager' (b24f2601-9bad-484e-a6ad-0e94a1569666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff755d8-ea92-458e-b2fb-7a63dc8219b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff755d8-ea92-458e-b2fb-7a63dc8219b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1674313990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241a2bf2-e96d-4979-9b44-ce16a2f2c6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fad5cd95c264a3fa78d319d3773fa39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:27:23Z,use_quota=True,user_id='0534fb351d894ae2a396d425d0df15a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3672767-8776-48e9-a6fa-9a87f7f0b5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3672767-8776-48e9-a6fa-9a87f7f0b5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3e5d2f-32e7-4cf5-8eaf-2a2f1386e589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3e5d2f-32e7-4cf5-8eaf-2a2f1386e589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '241a2bf2-e96d-4979-9b44-ce16a2f2c6c1', 'volume_name': 'volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695d268f-96eb-4938-baa4-468699287ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695d268f-96eb-4938-baa4-468699287ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26b8935-f76b-4ea9-81ef-dfe115d5abe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:23 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Volume 241a2bf2-e96d-4979-9b44-ce16a2f2c6c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1', 'volume_size': 1} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1674313990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241a2bf2-e96d-4979-9b44-ce16a2f2c6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fad5cd95c264a3fa78d319d3773fa39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:27:23Z,use_quota=True,user_id='0534fb351d894ae2a396d425d0df15a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Creating volume 241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:27:23 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:27:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:23 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 1073741824 Sep 10 18:27:23 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:24 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 1073741824" returned: 0 in 0.512s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:24 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 Sep 10 18:27:24 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:24 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1" returned: 0 in 0.272s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:24 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:27:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26b8935-f76b-4ea9-81ef-dfe115d5abe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bea1a43-0667-40fe-a22c-1ec0d6b78226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:24 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Volume volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 (241a2bf2-e96d-4979-9b44-ce16a2f2c6c1): created successfully Sep 10 18:27:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bea1a43-0667-40fe-a22c-1ec0d6b78226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Flow 'volume_create_manager' (b24f2601-9bad-484e-a6ad-0e94a1569666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:27:24 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-6e9b65c8-2356-4064-abbc-1ae249221464 tempest-VolumesDeleteCascade-2050521027 None] Created volume successfully. Sep 10 18:27:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8ace0078-0b71-4f25-8c9c-82ed106f2198 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8ace0078-0b71-4f25-8c9c-82ed106f2198 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:26 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-8ace0078-0b71-4f25-8c9c-82ed106f2198 tempest-VolumesDeleteCascade-2050521027 None] Creating offline snapshot 26a049eb-88cf-45bf-a843-8478a7386ad2 of volume 241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:27:26 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c59dcd-c75a-4f81-9a28-62aea5669d20]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8ace0078-0b71-4f25-8c9c-82ed106f2198 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:26 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 Sep 10 18:27:26 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:26 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-ddb7a9b9-a179-46da-8b32-4126a937b9f6 req-d0a8a2ae-23ce-479d-a890-cdd04e676b35 tempest-AttachVolumeTestJSON-1356128937 None] Terminate volume connection completed successfully. Sep 10 18:27:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-ddb7a9b9-a179-46da-8b32-4126a937b9f6 req-d0a8a2ae-23ce-479d-a890-cdd04e676b35 tempest-AttachVolumeTestJSON-1356128937 None] Deleting attachment a25e68a7-f468-4070-ad6f-72e94091d1dc. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:27:26 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8ace0078-0b71-4f25-8c9c-82ed106f2198 tempest-VolumesDeleteCascade-2050521027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1" returned: 0 in 0.617s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8ace0078-0b71-4f25-8c9c-82ed106f2198 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:26 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 1G Sep 10 18:27:26 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:27 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8ace0078-0b71-4f25-8c9c-82ed106f2198 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 1G" returned: 0 in 0.579s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8ace0078-0b71-4f25-8c9c-82ed106f2198 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:27 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 Sep 10 18:27:27 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:27 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8ace0078-0b71-4f25-8c9c-82ed106f2198 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2" returned: 0 in 0.463s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:27 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-8ace0078-0b71-4f25-8c9c-82ed106f2198 tempest-VolumesDeleteCascade-2050521027 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 is being set with open permissions: ugo+rw Sep 10 18:27:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8ace0078-0b71-4f25-8c9c-82ed106f2198 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:27 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 Sep 10 18:27:27 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:28 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8ace0078-0b71-4f25-8c9c-82ed106f2198 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2" returned: 0 in 0.279s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:28 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-55bf1243-218a-409b-8856-2d59bae47464 req-f5904d6e-1de6-4a30-a305-ac085bba441c tempest-AttachVolumeTestJSON-1356128937 None] Terminate volume connection completed successfully. Sep 10 18:27:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-55bf1243-218a-409b-8856-2d59bae47464 req-f5904d6e-1de6-4a30-a305-ac085bba441c tempest-AttachVolumeTestJSON-1356128937 None] Deleting attachment 4e51b821-f938-48b5-9012-af6d5485d988. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:27:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8ace0078-0b71-4f25-8c9c-82ed106f2198 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:28 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.info Sep 10 18:27:28 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:28 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8ace0078-0b71-4f25-8c9c-82ed106f2198 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.info" returned: 0 in 0.284s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:28 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-8ace0078-0b71-4f25-8c9c-82ed106f2198 tempest-VolumesDeleteCascade-2050521027 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.info is being set with open permissions: ugo+rw Sep 10 18:27:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8ace0078-0b71-4f25-8c9c-82ed106f2198 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:28 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.info Sep 10 18:27:28 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:28 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8ace0078-0b71-4f25-8c9c-82ed106f2198 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.info" returned: 0 in 0.280s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8ace0078-0b71-4f25-8c9c-82ed106f2198 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.654s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:28 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-8ace0078-0b71-4f25-8c9c-82ed106f2198 tempest-VolumesDeleteCascade-2050521027 None] Create snapshot completed successfully Sep 10 18:27:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:27:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:29 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:27:29 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:29 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.413s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:27:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:27:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 28 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:27:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:27:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3d3545f2-f343-47ef-83bc-592b8a566cb6 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3d3545f2-f343-47ef-83bc-592b8a566cb6 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-3d3545f2-f343-47ef-83bc-592b8a566cb6 tempest-VolumesDeleteCascade-2050521027 None] Creating offline snapshot ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 of volume 241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:27:29 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c73d4ec-1b52-493e-8e40-8c03d201b79a]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3d3545f2-f343-47ef-83bc-592b8a566cb6 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:29 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 Sep 10 18:27:29 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:30 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3d3545f2-f343-47ef-83bc-592b8a566cb6 tempest-VolumesDeleteCascade-2050521027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2" returned: 0 in 0.634s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-3d3545f2-f343-47ef-83bc-592b8a566cb6 tempest-VolumesDeleteCascade-2050521027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:27:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3d3545f2-f343-47ef-83bc-592b8a566cb6 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:30 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 1G Sep 10 18:27:30 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] Acquiring lock "cinder-f5bb978b-07c6-4050-9506-28bf0a8e070b-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] Lock "cinder-f5bb978b-07c6-4050-9506-28bf0a8e070b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:30 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:UPDATE=82,cinder:DELETE=12,cinder:SELECT=94,cinder:INSERT=21 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:27:30 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:UPDATE=105,cinder:SELECT=88,cinder:INSERT=28,cinder:DELETE=6 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:27:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] Acquiring lock "cinder-quobyte-f5bb978b-07c6-4050-9506-28bf0a8e070b" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] Lock "cinder-quobyte-f5bb978b-07c6-4050-9506-28bf0a8e070b" acquired by "delete_volume" :: waited 0.034s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:30 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e2da64-725f-4823-86a5-5722bf8f0737]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f5bb978b-07c6-4050-9506-28bf0a8e070b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:31 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f5bb978b-07c6-4050-9506-28bf0a8e070b Sep 10 18:27:31 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:31 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3d3545f2-f343-47ef-83bc-592b8a566cb6 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 1G" returned: 0 in 0.874s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3d3545f2-f343-47ef-83bc-592b8a566cb6 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:31 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 Sep 10 18:27:31 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:31 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f5bb978b-07c6-4050-9506-28bf0a8e070b" returned: 0 in 0.582s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f5bb978b-07c6-4050-9506-28bf0a8e070b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:31 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f5bb978b-07c6-4050-9506-28bf0a8e070b Sep 10 18:27:31 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:31 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3d3545f2-f343-47ef-83bc-592b8a566cb6 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3" returned: 0 in 0.466s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:31 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-3d3545f2-f343-47ef-83bc-592b8a566cb6 tempest-VolumesDeleteCascade-2050521027 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 is being set with open permissions: ugo+rw Sep 10 18:27:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3d3545f2-f343-47ef-83bc-592b8a566cb6 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:31 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 Sep 10 18:27:31 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:31 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f5bb978b-07c6-4050-9506-28bf0a8e070b" returned: 0 in 0.292s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] Lock "cinder-quobyte-f5bb978b-07c6-4050-9506-28bf0a8e070b" released by "delete_volume" :: held 0.933s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:31 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] Created reservations ['941806af-2a75-4bce-ab04-adc0d8af7b10', 'd65a9f68-2101-403d-a6cd-e539e323669e', '946ad990-a8a1-4210-8ad6-9449efe73bff', '585d4c98-1d20-41c0-a557-78be16aa5aff'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:27:31 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3d3545f2-f343-47ef-83bc-592b8a566cb6 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3" returned: 0 in 0.313s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3d3545f2-f343-47ef-83bc-592b8a566cb6 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.442s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:31 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-3d3545f2-f343-47ef-83bc-592b8a566cb6 tempest-VolumesDeleteCascade-2050521027 None] Create snapshot completed successfully Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:32 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:27:32 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:32 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.254s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:27:32 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] Deleted volume successfully. Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1d7a171c-662a-412e-8d82-bebec2a6bf6d tempest-AttachVolumeShelveTestJSON-1909036614 None] Lock "cinder-f5bb978b-07c6-4050-9506-28bf0a8e070b-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "cinder-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Performing cascade delete. {{(pid=87842) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "cinder-26a049eb-88cf-45bf-a843-8478a7386ad2-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-26a049eb-88cf-45bf-a843-8478a7386ad2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "cinder-quobyte-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "cinder-quobyte-26a049eb-88cf-45bf-a843-8478a7386ad2" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-26a049eb-88cf-45bf-a843-8478a7386ad2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Deleting offline snapshot 26a049eb-88cf-45bf-a843-8478a7386ad2 of volume 241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] snapshot_file for this snap is: volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[523ce850-799e-41bc-a95c-0e206db47e1a]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:33 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 Sep 10 18:27:33 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:33 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2" returned: 0 in 0.414s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:27:33 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3414e921-f94e-499d-9aae-7b6905121790]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:33 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 Sep 10 18:27:33 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:33 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1" returned: 0 in 0.485s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:33 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d2d021-83f4-46b3-ba06-3ae45f6aa962]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:34 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 Sep 10 18:27:34 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:34 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3" returned: 0 in 0.507s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:27:34 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4681e5-0b0c-4b49-be9f-6ce868f876ad]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:34 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 Sep 10 18:27:34 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] Acquiring lock "cinder-972d85d1-a98b-4674-8a91-3b171f8c2eb8-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:34 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2" returned: 0 in 0.464s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:27:34 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cabac31-d764-47bc-aceb-3202984ebaad]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] Lock "cinder-972d85d1-a98b-4674-8a91-3b171f8c2eb8-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] Acquiring lock "cinder-quobyte-972d85d1-a98b-4674-8a91-3b171f8c2eb8" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] Lock "cinder-quobyte-972d85d1-a98b-4674-8a91-3b171f8c2eb8" acquired by "delete_volume" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:35 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f5eaa7-34aa-4d4b-89c7-c6ab91237fc1]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-972d85d1-a98b-4674-8a91-3b171f8c2eb8 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:35 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 Sep 10 18:27:35 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:35 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-972d85d1-a98b-4674-8a91-3b171f8c2eb8 Sep 10 18:27:35 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:35 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1" returned: 0 in 0.450s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:35 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 Sep 10 18:27:35 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:35 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-972d85d1-a98b-4674-8a91-3b171f8c2eb8" returned: 0 in 0.410s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-972d85d1-a98b-4674-8a91-3b171f8c2eb8 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:35 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-972d85d1-a98b-4674-8a91-3b171f8c2eb8 Sep 10 18:27:35 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:35 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2" returned: 0 in 0.423s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:35 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-972d85d1-a98b-4674-8a91-3b171f8c2eb8" returned: 0 in 0.317s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:35 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2 Sep 10 18:27:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] Lock "cinder-quobyte-972d85d1-a98b-4674-8a91-3b171f8c2eb8" released by "delete_volume" :: held 0.777s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:35 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:35 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] Created reservations ['f8e95768-a84b-4f16-a031-c4c6ada97d99', 'dc3879a2-26db-415e-b234-43a3a33f6020', '732df7df-b0c9-4b29-911a-20fa8e762aa5', '2ad89198-1048-4145-a869-7cc27eeb6a4a'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:36 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:27:36 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] Acquiring lock "cinder-fc162c60-50dd-4239-883d-8fad75949ed6-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:36 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] Lock "cinder-fc162c60-50dd-4239-883d-8fad75949ed6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.26a049eb-88cf-45bf-a843-8478a7386ad2" returned: 0 in 0.492s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 -F qcow2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:36 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 -F qcow2 Sep 10 18:27:36 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] Acquiring lock "cinder-quobyte-fc162c60-50dd-4239-883d-8fad75949ed6" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] Lock "cinder-quobyte-fc162c60-50dd-4239-883d-8fad75949ed6" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:36 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.407s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:27:36 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] Deleted volume successfully. Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[294868cf-224a-490a-acec-852ba4d30904]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc162c60-50dd-4239-883d-8fad75949ed6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-14757e13-f11b-42e0-bf4a-154a42a452f7 tempest-AttachVolumeTestJSON-1356128937 None] Lock "cinder-972d85d1-a98b-4674-8a91-3b171f8c2eb8-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:36 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc162c60-50dd-4239-883d-8fad75949ed6 Sep 10 18:27:36 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:36 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 -F qcow2" returned: 0 in 0.413s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-26a049eb-88cf-45bf-a843-8478a7386ad2" released by "_delete_snapshot" :: held 3.870s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1" released by "delete_snapshot" :: held 3.893s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Created reservations ['51b3d814-e4dc-48e4-a2e3-707e0fb9a0e2', '692b4210-a8cb-4c02-a963-3b3e99fc2bbb', '3b5e96bb-b655-482e-8ffd-f93cd1c12f20', '809d3622-2de7-4818-9d24-0bb01ded6b81'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:27:36 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Delete snapshot completed successfully. Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-26a049eb-88cf-45bf-a843-8478a7386ad2-delete_snapshot" released by "delete_snapshot" :: held 4.077s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "cinder-ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:36 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "cinder-quobyte-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc162c60-50dd-4239-883d-8fad75949ed6" returned: 0 in 0.493s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc162c60-50dd-4239-883d-8fad75949ed6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "cinder-quobyte-ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:36 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc162c60-50dd-4239-883d-8fad75949ed6 Sep 10 18:27:36 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Deleting offline snapshot ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 of volume 241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] snapshot_file for this snap is: volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c07675-b28d-431b-91d3-443a2c3a6369]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:37 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 Sep 10 18:27:37 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:37 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc162c60-50dd-4239-883d-8fad75949ed6" returned: 0 in 0.272s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] Lock "cinder-quobyte-fc162c60-50dd-4239-883d-8fad75949ed6" released by "delete_volume" :: held 0.833s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] Created reservations ['86c1732f-0719-46b1-b802-352a20b510d3', '6927fc3d-80ee-4992-94f3-00d714da2f54', '64670980-9589-48db-8c4b-d903ae5ad959', '4dc40815-3c66-4825-b533-1e1410dafa80'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:37 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:27:37 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:37 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3" returned: 0 in 0.483s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c97a77f-9f7e-479e-a760-17e1d5923e4f]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] Acquiring lock "cinder-c3fb1602-8e39-4ca7-896b-5603e5691aab-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] Lock "cinder-c3fb1602-8e39-4ca7-896b-5603e5691aab-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:37 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 Sep 10 18:27:37 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] Acquiring lock "cinder-quobyte-c3fb1602-8e39-4ca7-896b-5603e5691aab" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] Lock "cinder-quobyte-c3fb1602-8e39-4ca7-896b-5603e5691aab" acquired by "delete_volume" :: waited 0.036s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:37 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.349s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d61808-dbe1-4c69-8043-45470c26f065]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3fb1602-8e39-4ca7-896b-5603e5691aab {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:37 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] Deleted volume successfully. Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1e3ba311-5bcd-4242-a91c-fc2266ea8dc5 tempest-AttachVolumeTestJSON-1356128937 None] Lock "cinder-fc162c60-50dd-4239-883d-8fad75949ed6-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:37 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3fb1602-8e39-4ca7-896b-5603e5691aab Sep 10 18:27:37 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:37 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1" returned: 0 in 0.430s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:38 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 Sep 10 18:27:38 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:38 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3fb1602-8e39-4ca7-896b-5603e5691aab" returned: 0 in 0.429s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3fb1602-8e39-4ca7-896b-5603e5691aab {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:38 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3fb1602-8e39-4ca7-896b-5603e5691aab Sep 10 18:27:38 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:38 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3" returned: 0 in 0.434s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:38 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3 Sep 10 18:27:38 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:38 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3fb1602-8e39-4ca7-896b-5603e5691aab" returned: 0 in 0.341s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] Lock "cinder-quobyte-c3fb1602-8e39-4ca7-896b-5603e5691aab" released by "delete_volume" :: held 0.850s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] Created reservations ['e437dc02-ddcf-4b8f-b89c-ee7d1a4b4dfb', '4121b61c-bb99-48e8-8f71-0d67aa188e3d', '1dbfc464-f9f6-4b5d-ae0a-a205336165ac', 'a05626e4-0c4a-4060-a380-068508702b96'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:27:38 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1.ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3" returned: 0 in 0.288s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3" released by "_delete_snapshot" :: held 1.743s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1" released by "delete_snapshot" :: held 1.775s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:38 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:27:38 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Created reservations ['b197917a-9ce2-4dbb-bd02-acc2105c36c8', 'cd5470d7-611d-4574-a9d3-410e76329eb7', '8f4a012f-fdc5-4dd8-9639-90df805b9a20', 'f480ea98-eb62-4536-a680-64efd78c4257'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:27:38 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Delete snapshot completed successfully. Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-ba75fc68-9e8d-4fe7-9bdd-4ddda8065ac3-delete_snapshot" released by "delete_snapshot" :: held 2.058s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Snapshots deleted, issuing volume delete {{(pid=87842) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 10 18:27:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "cinder-quobyte-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:39 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1" acquired by "delete_volume" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:39 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1d2bfb-867e-486a-b4c1-0ca7aa39d9e8]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:39 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.403s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:39 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:27:39 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] Deleted volume successfully. Sep 10 18:27:39 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 Sep 10 18:27:39 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:39 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a06467e4-60c6-492d-ab8b-982c5b6465d4 tempest-AttachVolumeTestJSON-1356128937 None] Lock "cinder-c3fb1602-8e39-4ca7-896b-5603e5691aab-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:39 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1" returned: 0 in 0.452s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:39 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1 Sep 10 18:27:39 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:39 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1" returned: 0 in 0.317s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:39 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1" released by "delete_volume" :: held 0.848s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:39 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Created reservations ['26b8587f-950e-43a9-a1f3-835f8de9d57a', '71afd135-ae7d-4c1a-8280-ad401d8a9e03', '6a8ff611-bc25-4883-a07d-29462d1d68d6', '6947b5f2-7527-4f07-9de4-65714118108f'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:27:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:40 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:40 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:40 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:27:40 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:40 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.385s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:40 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:27:40 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Deleted volume successfully. Sep 10 18:27:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6cd422e2-5e6f-4a99-a018-92f469475863 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-241a2bf2-e96d-4979-9b44-ce16a2f2c6c1-delete_volume" released by "delete_volume" :: held 7.748s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Flow 'volume_create_manager' (9209b5b7-9154-46a2-a4bb-de8c10e7f7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbccc310-4daa-4dbd-be7e-8edbded43a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbccc310-4daa-4dbd-be7e-8edbded43a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-165924855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe7968e-9947-40b4-ad99-214c93fced55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fad5cd95c264a3fa78d319d3773fa39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:27:42Z,use_quota=True,user_id='0534fb351d894ae2a396d425d0df15a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03696280-c288-43ee-a70e-1cec85d4d3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03696280-c288-43ee-a70e-1cec85d4d3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244c7e63-f8e8-4a58-bb44-a170f7543adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244c7e63-f8e8-4a58-bb44-a170f7543adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afe7968e-9947-40b4-ad99-214c93fced55', 'volume_name': 'volume-afe7968e-9947-40b4-ad99-214c93fced55', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7083a11d-786e-44d1-b101-2e979edfaa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7083a11d-786e-44d1-b101-2e979edfaa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efed699b-1e81-451f-84de-d10474e4baaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:41 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Volume afe7968e-9947-40b4-ad99-214c93fced55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afe7968e-9947-40b4-ad99-214c93fced55', 'volume_size': 1} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-165924855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe7968e-9947-40b4-ad99-214c93fced55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fad5cd95c264a3fa78d319d3773fa39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:27:42Z,use_quota=True,user_id='0534fb351d894ae2a396d425d0df15a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Creating volume afe7968e-9947-40b4-ad99-214c93fced55 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:27:41 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:27:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:41 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55 1073741824 Sep 10 18:27:41 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:42 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55 1073741824" returned: 0 in 0.635s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:42 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55 Sep 10 18:27:42 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:42 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55" returned: 0 in 0.410s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:27:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efed699b-1e81-451f-84de-d10474e4baaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afe7968e-9947-40b4-ad99-214c93fced55', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9962a05c-7190-4944-9ba2-5d91b3bfc404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:42 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Volume volume-afe7968e-9947-40b4-ad99-214c93fced55 (afe7968e-9947-40b4-ad99-214c93fced55): created successfully Sep 10 18:27:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9962a05c-7190-4944-9ba2-5d91b3bfc404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Flow 'volume_create_manager' (9209b5b7-9154-46a2-a4bb-de8c10e7f7eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:27:43 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c61b3ef2-30ca-4d36-a607-165a3895db52 tempest-VolumesDeleteCascade-2050521027 None] Created volume successfully. Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-959bb923-ba54-4628-9b60-7fd9dee18487 req-56296fb9-15ca-4fce-9fee-fb0c3f580bcd tempest-TestInstancesWithCinderVolumes-1476110052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-959bb923-ba54-4628-9b60-7fd9dee18487 req-56296fb9-15ca-4fce-9fee-fb0c3f580bcd tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-959bb923-ba54-4628-9b60-7fd9dee18487 req-56296fb9-15ca-4fce-9fee-fb0c3f580bcd tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-959bb923-ba54-4628-9b60-7fd9dee18487 req-56296fb9-15ca-4fce-9fee-fb0c3f580bcd tempest-TestInstancesWithCinderVolumes-1476110052 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-48939293-6b80-4228-bfd1-adb0a72d4fd2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18838e5f-3038-4ec1-aa36-5f873a3cfb70', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:27:43 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-959bb923-ba54-4628-9b60-7fd9dee18487 req-56296fb9-15ca-4fce-9fee-fb0c3f580bcd tempest-TestInstancesWithCinderVolumes-1476110052 None] attachment_update completed successfully. Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Flow 'volume_create_manager' (94c78245-8809-46a4-92ce-dcb01e909cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a09717-9f6e-4822-8402-fbf01f8beff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a09717-9f6e-4822-8402-fbf01f8beff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-682369006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27caa222-3f66-4353-8865-e62f2368a3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d652aa17eb604b57a26901b7e52b48ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:27:43Z,use_quota=True,user_id='e0872c4bf21b42fcbd0029f5d6d783c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51193fac-34ce-40bc-a81a-b90346380b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51193fac-34ce-40bc-a81a-b90346380b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aed8317-937a-43b1-8fb5-eaa9d122b386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aed8317-937a-43b1-8fb5-eaa9d122b386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27caa222-3f66-4353-8865-e62f2368a3d6', 'volume_name': 'volume-27caa222-3f66-4353-8865-e62f2368a3d6', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5481986-82d9-4e8d-991b-54f9f51671ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5481986-82d9-4e8d-991b-54f9f51671ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ca772e-9cdb-4234-904c-824c7f687b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:43 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Volume 27caa222-3f66-4353-8865-e62f2368a3d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27caa222-3f66-4353-8865-e62f2368a3d6', 'volume_size': 1} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-682369006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27caa222-3f66-4353-8865-e62f2368a3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d652aa17eb604b57a26901b7e52b48ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:27:43Z,use_quota=True,user_id='e0872c4bf21b42fcbd0029f5d6d783c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Creating volume 27caa222-3f66-4353-8865-e62f2368a3d6 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:27:43 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:43 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6 1073741824 Sep 10 18:27:43 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:43 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6 1073741824" returned: 0 in 0.604s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:44 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6 Sep 10 18:27:44 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-61450447-ff38-4dd7-8bb0-67d3de4f470e tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:44 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6" returned: 0 in 0.304s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:27:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-61450447-ff38-4dd7-8bb0-67d3de4f470e tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.119s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-61450447-ff38-4dd7-8bb0-67d3de4f470e tempest-VolumesDeleteCascade-2050521027 None] Creating offline snapshot 6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 of volume afe7968e-9947-40b4-ad99-214c93fced55 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:27:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ca772e-9cdb-4234-904c-824c7f687b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27caa222-3f66-4353-8865-e62f2368a3d6', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b39b6c-3784-48b7-a67e-b59509536a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:44 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aff2575-38b5-4b41-9de6-8eca51b2110d]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-61450447-ff38-4dd7-8bb0-67d3de4f470e tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:44 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Volume volume-27caa222-3f66-4353-8865-e62f2368a3d6 (27caa222-3f66-4353-8865-e62f2368a3d6): created successfully Sep 10 18:27:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b39b6c-3784-48b7-a67e-b59509536a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Flow 'volume_create_manager' (94c78245-8809-46a4-92ce-dcb01e909cda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:27:44 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-cba83dfb-8ef7-4b92-a903-be86783fa16b req-1c68f573-9ebe-4042-9784-e29dbc4bc099 tempest-VolumesSnapshotsTestJSON-2142458050 None] Created volume successfully. Sep 10 18:27:44 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55 Sep 10 18:27:44 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:44 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-61450447-ff38-4dd7-8bb0-67d3de4f470e tempest-VolumesDeleteCascade-2050521027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55" returned: 0 in 0.428s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-61450447-ff38-4dd7-8bb0-67d3de4f470e tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:44 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 1G Sep 10 18:27:44 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-a9ded297-a09a-46b6-9047-1bd36817262e req-e453134e-94fc-4fd0-b6e4-31e66404a2fc tempest-TestInstancesWithCinderVolumes-1476110052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:45 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-61450447-ff38-4dd7-8bb0-67d3de4f470e tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 1G" returned: 0 in 0.565s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-61450447-ff38-4dd7-8bb0-67d3de4f470e tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe7968e-9947-40b4-ad99-214c93fced55 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:45 devstack sudo[98393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe7968e-9947-40b4-ad99-214c93fced55 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 Sep 10 18:27:45 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-ec50f5e7-3833-4f60-9082-6e25a18043b6 req-d211de34-5407-4d00-bc6b-cefc1efd2d8d tempest-VolumesSnapshotsTestJSON-2142458050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:45 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-61450447-ff38-4dd7-8bb0-67d3de4f470e tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe7968e-9947-40b4-ad99-214c93fced55 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99" returned: 0 in 0.336s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:45 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-61450447-ff38-4dd7-8bb0-67d3de4f470e tempest-VolumesDeleteCascade-2050521027 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 is being set with open permissions: ugo+rw Sep 10 18:27:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-61450447-ff38-4dd7-8bb0-67d3de4f470e tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:45 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 Sep 10 18:27:45 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:45 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-61450447-ff38-4dd7-8bb0-67d3de4f470e tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99" returned: 0 in 0.279s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-61450447-ff38-4dd7-8bb0-67d3de4f470e tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:46 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.info Sep 10 18:27:46 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:46 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-61450447-ff38-4dd7-8bb0-67d3de4f470e tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.info" returned: 0 in 0.305s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:46 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-61450447-ff38-4dd7-8bb0-67d3de4f470e tempest-VolumesDeleteCascade-2050521027 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.info is being set with open permissions: ugo+rw Sep 10 18:27:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-61450447-ff38-4dd7-8bb0-67d3de4f470e tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:46 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.info Sep 10 18:27:46 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:46 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-61450447-ff38-4dd7-8bb0-67d3de4f470e tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.info" returned: 0 in 0.249s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-61450447-ff38-4dd7-8bb0-67d3de4f470e tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-a9ded297-a09a-46b6-9047-1bd36817262e req-e453134e-94fc-4fd0-b6e4-31e66404a2fc tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.281s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-a9ded297-a09a-46b6-9047-1bd36817262e req-e453134e-94fc-4fd0-b6e4-31e66404a2fc tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-ec50f5e7-3833-4f60-9082-6e25a18043b6 req-d211de34-5407-4d00-bc6b-cefc1efd2d8d tempest-VolumesSnapshotsTestJSON-2142458050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.955s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:46 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-61450447-ff38-4dd7-8bb0-67d3de4f470e tempest-VolumesDeleteCascade-2050521027 None] Create snapshot completed successfully Sep 10 18:27:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [req-ec50f5e7-3833-4f60-9082-6e25a18043b6 req-d211de34-5407-4d00-bc6b-cefc1efd2d8d tempest-VolumesSnapshotsTestJSON-2142458050 None] Creating offline snapshot 7ebe9ffb-9bd8-495f-a7c4-261de56cdb19 of volume 27caa222-3f66-4353-8865-e62f2368a3d6 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:27:46 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[88222079-17f2-420d-97d6-8d1a3a259fed]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-ec50f5e7-3833-4f60-9082-6e25a18043b6 req-d211de34-5407-4d00-bc6b-cefc1efd2d8d tempest-VolumesSnapshotsTestJSON-2142458050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-a9ded297-a09a-46b6-9047-1bd36817262e req-e453134e-94fc-4fd0-b6e4-31e66404a2fc tempest-TestInstancesWithCinderVolumes-1476110052 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9303a25f-7813-4cc4-8d2a-d36ecc943bf8', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:27:46 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-a9ded297-a09a-46b6-9047-1bd36817262e req-e453134e-94fc-4fd0-b6e4-31e66404a2fc tempest-TestInstancesWithCinderVolumes-1476110052 None] attachment_update completed successfully. Sep 10 18:27:46 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6 Sep 10 18:27:46 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:47 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-ec50f5e7-3833-4f60-9082-6e25a18043b6 req-d211de34-5407-4d00-bc6b-cefc1efd2d8d tempest-VolumesSnapshotsTestJSON-2142458050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6" returned: 0 in 0.470s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-ec50f5e7-3833-4f60-9082-6e25a18043b6 req-d211de34-5407-4d00-bc6b-cefc1efd2d8d tempest-VolumesSnapshotsTestJSON-2142458050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:47 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19 1G Sep 10 18:27:47 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:47 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-ec50f5e7-3833-4f60-9082-6e25a18043b6 req-d211de34-5407-4d00-bc6b-cefc1efd2d8d tempest-VolumesSnapshotsTestJSON-2142458050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19 1G" returned: 0 in 0.510s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-ec50f5e7-3833-4f60-9082-6e25a18043b6 req-d211de34-5407-4d00-bc6b-cefc1efd2d8d tempest-VolumesSnapshotsTestJSON-2142458050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27caa222-3f66-4353-8865-e62f2368a3d6 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:47 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27caa222-3f66-4353-8865-e62f2368a3d6 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19 Sep 10 18:27:47 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:47 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-ec50f5e7-3833-4f60-9082-6e25a18043b6 req-d211de34-5407-4d00-bc6b-cefc1efd2d8d tempest-VolumesSnapshotsTestJSON-2142458050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27caa222-3f66-4353-8865-e62f2368a3d6 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19" returned: 0 in 0.334s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:47 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [req-ec50f5e7-3833-4f60-9082-6e25a18043b6 req-d211de34-5407-4d00-bc6b-cefc1efd2d8d tempest-VolumesSnapshotsTestJSON-2142458050 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19 is being set with open permissions: ugo+rw Sep 10 18:27:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-ec50f5e7-3833-4f60-9082-6e25a18043b6 req-d211de34-5407-4d00-bc6b-cefc1efd2d8d tempest-VolumesSnapshotsTestJSON-2142458050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:48 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19 Sep 10 18:27:48 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Flow 'volume_create_manager' (7334fa86-9964-47b9-b69a-3feadf2449a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a77f76-876c-4c34-8029-6bc1a6a3de7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a77f76-876c-4c34-8029-6bc1a6a3de7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1618884836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747bf5b4-1974-4d31-867c-e70e556c31bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fad5cd95c264a3fa78d319d3773fa39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6519ab3c-f5f9-469d-94a7-5ddbd53c0a99,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:27:48Z,use_quota=True,user_id='0534fb351d894ae2a396d425d0df15a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbf2874-e3d1-4456-a521-08f27465c0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbf2874-e3d1-4456-a521-08f27465c0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f3bd55-d80d-4645-8ac6-5c90941764a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f3bd55-d80d-4645-8ac6-5c90941764a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '747bf5b4-1974-4d31-867c-e70e556c31bc', 'volume_name': 'volume-747bf5b4-1974-4d31-867c-e70e556c31bc', 'volume_size': 1, 'snapshot_id': '6519ab3c-f5f9-469d-94a7-5ddbd53c0a99'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bf8e5e-0929-4d01-8ad6-881e7bb90946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bf8e5e-0929-4d01-8ad6-881e7bb90946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7234b67-c937-4247-b24e-99baac1dbce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:48 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Volume 747bf5b4-1974-4d31-867c-e70e556c31bc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-747bf5b4-1974-4d31-867c-e70e556c31bc', 'volume_size': 1, 'snapshot_id': '6519ab3c-f5f9-469d-94a7-5ddbd53c0a99'} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:48 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-ec50f5e7-3833-4f60-9082-6e25a18043b6 req-d211de34-5407-4d00-bc6b-cefc1efd2d8d tempest-VolumesSnapshotsTestJSON-2142458050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19" returned: 0 in 0.289s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-ec50f5e7-3833-4f60-9082-6e25a18043b6 req-d211de34-5407-4d00-bc6b-cefc1efd2d8d tempest-VolumesSnapshotsTestJSON-2142458050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:48 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.info Sep 10 18:27:48 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Flow 'volume_create_manager' (6c44c42e-0924-4397-8c81-15580db6bc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1912598b-9fe1-4d99-bd9b-1d422399fc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1912598b-9fe1-4d99-bd9b-1d422399fc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1555860352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f245e0a-ccc1-479e-b535-c146a420db1a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='432700ad4aea4ea78f50aed60115550b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:27:48Z,use_quota=True,user_id='e42f863c4c6a43afbb9096742bca5427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762913a6-7012-4a2c-a140-231b86afb66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762913a6-7012-4a2c-a140-231b86afb66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecae0a8c-7fda-4996-afcf-f0052575c0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecae0a8c-7fda-4996-afcf-f0052575c0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f245e0a-ccc1-479e-b535-c146a420db1a', 'volume_name': 'volume-2f245e0a-ccc1-479e-b535-c146a420db1a', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7493fa-a6b9-4c52-a28e-a4494bd44880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7493fa-a6b9-4c52-a28e-a4494bd44880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7d2483-1bb8-4149-8c19-7d9ea7a6fb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:48 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Volume 2f245e0a-ccc1-479e-b535-c146a420db1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f245e0a-ccc1-479e-b535-c146a420db1a', 'volume_size': 1} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:48 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-ec50f5e7-3833-4f60-9082-6e25a18043b6 req-d211de34-5407-4d00-bc6b-cefc1efd2d8d tempest-VolumesSnapshotsTestJSON-2142458050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.info" returned: 0 in 0.285s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:48 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [req-ec50f5e7-3833-4f60-9082-6e25a18043b6 req-d211de34-5407-4d00-bc6b-cefc1efd2d8d tempest-VolumesSnapshotsTestJSON-2142458050 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.info is being set with open permissions: ugo+rw Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-ec50f5e7-3833-4f60-9082-6e25a18043b6 req-d211de34-5407-4d00-bc6b-cefc1efd2d8d tempest-VolumesSnapshotsTestJSON-2142458050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:48 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.info Sep 10 18:27:48 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:48 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-ec50f5e7-3833-4f60-9082-6e25a18043b6 req-d211de34-5407-4d00-bc6b-cefc1efd2d8d tempest-VolumesSnapshotsTestJSON-2142458050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.info" returned: 0 in 0.250s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-ec50f5e7-3833-4f60-9082-6e25a18043b6 req-d211de34-5407-4d00-bc6b-cefc1efd2d8d tempest-VolumesSnapshotsTestJSON-2142458050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.730s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "cinder-quobyte-6519ab3c-f5f9-469d-94a7-5ddbd53c0a99-747bf5b4-1974-4d31-867c-e70e556c31bc" by "_create_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-6519ab3c-f5f9-469d-94a7-5ddbd53c0a99-747bf5b4-1974-4d31-867c-e70e556c31bc" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Creating volume 747bf5b4-1974-4d31-867c-e70e556c31bc from snapshot 6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 {{(pid=87842) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "cinder-quobyte-747bf5b4-1974-4d31-867c-e70e556c31bc" by "_copy_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:48 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-ec50f5e7-3833-4f60-9082-6e25a18043b6 req-d211de34-5407-4d00-bc6b-cefc1efd2d8d tempest-VolumesSnapshotsTestJSON-2142458050 None] Create snapshot completed successfully Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-747bf5b4-1974-4d31-867c-e70e556c31bc" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] snapshot: 6519ab3c-f5f9-469d-94a7-5ddbd53c0a99, volume: 747bf5b4-1974-4d31-867c-e70e556c31bc, {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3543a10-8862-43f5-88af-7a0c378735aa]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:49 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 Sep 10 18:27:49 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:49 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99" returned: 0 in 0.382s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe7968e-9947-40b4-ad99-214c93fced55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d519d46-c1bc-48a7-a470-649cefb77410]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:49 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55 Sep 10 18:27:49 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] Acquiring lock "cinder-7ebe9ffb-9bd8-495f-a7c4-261de56cdb19-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] Lock "cinder-7ebe9ffb-9bd8-495f-a7c4-261de56cdb19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] Acquiring lock "cinder-quobyte-27caa222-3f66-4353-8865-e62f2368a3d6" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] Lock "cinder-quobyte-27caa222-3f66-4353-8865-e62f2368a3d6" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] Acquiring lock "cinder-quobyte-7ebe9ffb-9bd8-495f-a7c4-261de56cdb19" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] Lock "cinder-quobyte-7ebe9ffb-9bd8-495f-a7c4-261de56cdb19" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] Deleting offline snapshot 7ebe9ffb-9bd8-495f-a7c4-261de56cdb19 of volume 27caa222-3f66-4353-8865-e62f2368a3d6 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] snapshot_file for this snap is: volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f87e3c-ac28-4327-8fcc-6e7df66a7d4e]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:49 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55" returned: 0 in 0.405s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55 {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Creating direct copy from snapshot {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG cinder.utils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Path /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-747bf5b4-1974-4d31-867c-e70e556c31bc not found in is_blk_device check {{(pid=87842) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 18:27:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-747bf5b4-1974-4d31-867c-e70e556c31bc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:49 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-747bf5b4-1974-4d31-867c-e70e556c31bc Sep 10 18:27:49 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19 Sep 10 18:27:49 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:49 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:50 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19" returned: 0 in 0.407s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27caa222-3f66-4353-8865-e62f2368a3d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:27:50 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f9d9a3-b462-4013-be97-6eab2284f791]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:50 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6 Sep 10 18:27:50 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:50 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6" returned: 0 in 0.609s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:50 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19 Sep 10 18:27:50 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:51 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19" returned: 0 in 0.858s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:51 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19 Sep 10 18:27:51 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:52 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6.7ebe9ffb-9bd8-495f-a7c4-261de56cdb19" returned: 0 in 0.521s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:52 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] Lock "cinder-quobyte-7ebe9ffb-9bd8-495f-a7c4-261de56cdb19" released by "_delete_snapshot" :: held 2.626s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:52 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] Lock "cinder-quobyte-27caa222-3f66-4353-8865-e62f2368a3d6" released by "delete_snapshot" :: held 2.680s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:52 devstack cinder-volume[87842]: DEBUG cinder.quota [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] Created reservations ['6592e18a-20ba-4a4d-a2b1-134b3adee1dd', '6d98252c-c85b-4f73-bff3-2b73f7e931ed', '85d339d8-86ab-4247-b5d3-e5164db9bbd8', '33c82f08-d52e-4cdb-b501-37cbf39e3ba4'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:27:52 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] Delete snapshot completed successfully. Sep 10 18:27:52 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-bdeb1215-05e0-4a30-8820-9a674fc292cf req-c398e978-026e-4b26-8436-2385809a60a2 tempest-VolumesSnapshotsTestJSON-2142458050 None] Lock "cinder-7ebe9ffb-9bd8-495f-a7c4-261de56cdb19-delete_snapshot" released by "delete_snapshot" :: held 3.262s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] Acquiring lock "cinder-27caa222-3f66-4353-8865-e62f2368a3d6-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] Lock "cinder-27caa222-3f66-4353-8865-e62f2368a3d6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] Acquiring lock "cinder-quobyte-27caa222-3f66-4353-8865-e62f2368a3d6" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] Lock "cinder-quobyte-27caa222-3f66-4353-8865-e62f2368a3d6" acquired by "delete_volume" :: waited 0.028s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:53 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8370fb7e-7f06-47e1-88b3-de4cd72eada3]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:53 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-4e30242e-640b-402a-8b25-771fa25de0d1 req-52881b73-c17c-41dd-8741-deec8179d59b tempest-TestInstancesWithCinderVolumes-1476110052 None] Terminate volume connection completed successfully. Sep 10 18:27:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-4e30242e-640b-402a-8b25-771fa25de0d1 req-52881b73-c17c-41dd-8741-deec8179d59b tempest-TestInstancesWithCinderVolumes-1476110052 None] Deleting attachment 18838e5f-3038-4ec1-aa36-5f873a3cfb70. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:27:53 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6 Sep 10 18:27:53 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] Acquiring lock "cinder-48939293-6b80-4228-bfd1-adb0a72d4fd2-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "cinder-48939293-6b80-4228-bfd1-adb0a72d4fd2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] Acquiring lock "cinder-quobyte-48939293-6b80-4228-bfd1-adb0a72d4fd2" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "cinder-quobyte-48939293-6b80-4228-bfd1-adb0a72d4fd2" acquired by "delete_volume" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:54 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6" returned: 0 in 0.892s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:54 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c24baec-b2b7-4839-a383-fd9c01ca1e75]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-48939293-6b80-4228-bfd1-adb0a72d4fd2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:54 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6 Sep 10 18:27:54 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:54 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-48939293-6b80-4228-bfd1-adb0a72d4fd2 Sep 10 18:27:54 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:55 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-27caa222-3f66-4353-8865-e62f2368a3d6" returned: 0 in 0.726s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] Lock "cinder-quobyte-27caa222-3f66-4353-8865-e62f2368a3d6" released by "delete_volume" :: held 1.813s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:55 devstack cinder-volume[87842]: DEBUG cinder.quota [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] Created reservations ['c217d692-5492-4880-bef1-6cd6a17ff2f5', 'c69bea05-a2c2-47ce-8102-3aee2b16d576', '09ac6b54-e303-40e8-af84-7a1c0e036496', 'b75c3fde-db7d-48d0-8b4b-68921fa2c60c'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:27:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:55 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:55 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:55 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-48939293-6b80-4228-bfd1-adb0a72d4fd2" returned: 0 in 1.115s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-48939293-6b80-4228-bfd1-adb0a72d4fd2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:55 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:27:55 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:55 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-48939293-6b80-4228-bfd1-adb0a72d4fd2 Sep 10 18:27:55 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:55 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-747bf5b4-1974-4d31-867c-e70e556c31bc" returned: 0 in 5.971s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:55 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Image conversion details: src /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-747bf5b4-1974-4d31-867c-e70e556c31bc {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:27:55 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Converted 1024.00 MB image at 171.45 MB/s Sep 10 18:27:55 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-747bf5b4-1974-4d31-867c-e70e556c31bc is being set with open permissions: ugo+rw Sep 10 18:27:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-747bf5b4-1974-4d31-867c-e70e556c31bc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:55 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-747bf5b4-1974-4d31-867c-e70e556c31bc Sep 10 18:27:55 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:55 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.515s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:55 devstack cinder-volume[87842]: DEBUG cinder.manager [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:27:55 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] Deleted volume successfully. Sep 10 18:27:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-d1d05ade-bdb5-4864-bfbc-c1823eef53b4 req-62c71a8e-fd3d-47f2-8f1f-7118a482b67b tempest-VolumesSnapshotsTestJSON-2142458050 None] Lock "cinder-27caa222-3f66-4353-8865-e62f2368a3d6-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:55 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-48939293-6b80-4228-bfd1-adb0a72d4fd2" returned: 0 in 0.478s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "cinder-quobyte-48939293-6b80-4228-bfd1-adb0a72d4fd2" released by "delete_volume" :: held 1.690s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:55 devstack cinder-volume[87842]: WARNING cinder.quota [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1951119599-517668933 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1951119599-517668933, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:27:55 devstack cinder-volume[87842]: WARNING cinder.quota [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1951119599-517668933 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1951119599-517668933, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] Created reservations ['f4a77123-ba4d-4e2d-929f-8e43a9102078', '4c5101e5-1cd5-4702-87b6-e5e3438120d8', '4a0646cd-60d4-47ca-b9e6-87f26d4e1a0d', '6de03e13-b44a-497d-afa0-61611b276b92'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:56 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-747bf5b4-1974-4d31-867c-e70e556c31bc" returned: 0 in 0.336s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:56 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:27:56 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-747bf5b4-1974-4d31-867c-e70e556c31bc" released by "_copy_volume_from_snapshot" :: held 7.187s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-6519ab3c-f5f9-469d-94a7-5ddbd53c0a99-747bf5b4-1974-4d31-867c-e70e556c31bc" released by "_create_volume_from_snapshot" :: held 7.285s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.322s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.655s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1555860352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f245e0a-ccc1-479e-b535-c146a420db1a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='432700ad4aea4ea78f50aed60115550b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:27:48Z,use_quota=True,user_id='e42f863c4c6a43afbb9096742bca5427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Creating volume 2f245e0a-ccc1-479e-b535-c146a420db1a {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:27:56 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2f245e0a-ccc1-479e-b535-c146a420db1a 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:56 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2f245e0a-ccc1-479e-b535-c146a420db1a 1073741824 Sep 10 18:27:56 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7234b67-c937-4247-b24e-99baac1dbce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-747bf5b4-1974-4d31-867c-e70e556c31bc', 'volume_size': 1, 'snapshot_id': '6519ab3c-f5f9-469d-94a7-5ddbd53c0a99'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93364d01-18e1-4d2a-9acf-75449616e189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:56 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Volume volume-747bf5b4-1974-4d31-867c-e70e556c31bc (747bf5b4-1974-4d31-867c-e70e556c31bc): created successfully Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93364d01-18e1-4d2a-9acf-75449616e189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Flow 'volume_create_manager' (7334fa86-9964-47b9-b69a-3feadf2449a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:27:56 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-99ab6137-fb37-4ec1-ba79-ce395fdb0bb9 tempest-VolumesDeleteCascade-2050521027 None] Created volume successfully. Sep 10 18:27:56 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.388s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:27:56 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] Deleted volume successfully. Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f1c414c8-edad-4266-b72d-2d8feaf0cdde tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "cinder-48939293-6b80-4228-bfd1-adb0a72d4fd2-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:56 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2f245e0a-ccc1-479e-b535-c146a420db1a 1073741824" returned: 0 in 0.567s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2f245e0a-ccc1-479e-b535-c146a420db1a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:56 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2f245e0a-ccc1-479e-b535-c146a420db1a Sep 10 18:27:56 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "cinder-afe7968e-9947-40b4-ad99-214c93fced55-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-afe7968e-9947-40b4-ad99-214c93fced55-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Performing cascade delete. {{(pid=87842) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "cinder-6519ab3c-f5f9-469d-94a7-5ddbd53c0a99-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-6519ab3c-f5f9-469d-94a7-5ddbd53c0a99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "cinder-quobyte-afe7968e-9947-40b4-ad99-214c93fced55" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-afe7968e-9947-40b4-ad99-214c93fced55" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "cinder-quobyte-6519ab3c-f5f9-469d-94a7-5ddbd53c0a99" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-6519ab3c-f5f9-469d-94a7-5ddbd53c0a99" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:57 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Deleting offline snapshot 6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 of volume afe7968e-9947-40b4-ad99-214c93fced55 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] snapshot_file for this snap is: volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2f245e0a-ccc1-479e-b535-c146a420db1a" returned: 0 in 0.426s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74d8b0b-7c4d-4d5c-9dc4-dc014ddc2702]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7d2483-1bb8-4149-8c19-7d9ea7a6fb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f245e0a-ccc1-479e-b535-c146a420db1a', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60e2fc3-399a-4b94-9a02-fee5a259a007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:57 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Volume volume-2f245e0a-ccc1-479e-b535-c146a420db1a (2f245e0a-ccc1-479e-b535-c146a420db1a): created successfully Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60e2fc3-399a-4b94-9a02-fee5a259a007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Flow 'volume_create_manager' (6c44c42e-0924-4397-8c81-15580db6bc63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:27:57 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f96b819b-9dcb-4b93-8668-d9394a3368ec tempest-VolumesTestJSON-196246865 None] Created volume successfully. Sep 10 18:27:57 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 Sep 10 18:27:57 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:57 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99" returned: 0 in 0.464s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe7968e-9947-40b4-ad99-214c93fced55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[868959b4-cb8d-4a33-b16b-1629948236fe]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:57 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55 Sep 10 18:27:57 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Flow 'volume_create_manager' (e4cbbaa9-f072-45cd-bddb-2ed44d1619d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a154b17-ed4a-47e4-a780-856945a980a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a154b17-ed4a-47e4-a780-856945a980a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1475037080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00945a5-dc65-4af1-88b3-3cd99914cd03,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='432700ad4aea4ea78f50aed60115550b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:27:58Z,use_quota=True,user_id='e42f863c4c6a43afbb9096742bca5427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02e2e85-6759-4ff2-a837-bcdf12e9f7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02e2e85-6759-4ff2-a837-bcdf12e9f7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d4bc3a-ecec-4fff-ae60-ce17bccd73b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d4bc3a-ecec-4fff-ae60-ce17bccd73b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c00945a5-dc65-4af1-88b3-3cd99914cd03', 'volume_name': 'volume-c00945a5-dc65-4af1-88b3-3cd99914cd03', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42b91da-fbc4-4b24-bf42-a0aee7a5aaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42b91da-fbc4-4b24-bf42-a0aee7a5aaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafc36e8-e743-4d8a-9bd5-38092b4cd968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:58 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Volume c00945a5-dc65-4af1-88b3-3cd99914cd03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c00945a5-dc65-4af1-88b3-3cd99914cd03', 'volume_size': 1} Sep 10 18:27:58 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1475037080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00945a5-dc65-4af1-88b3-3cd99914cd03,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='432700ad4aea4ea78f50aed60115550b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:27:58Z,use_quota=True,user_id='e42f863c4c6a43afbb9096742bca5427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Creating volume c00945a5-dc65-4af1-88b3-3cd99914cd03 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:27:58 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c00945a5-dc65-4af1-88b3-3cd99914cd03 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55" returned: 0 in 0.711s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:58 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c00945a5-dc65-4af1-88b3-3cd99914cd03 1073741824 Sep 10 18:27:58 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:58 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 Sep 10 18:27:58 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:58 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99" returned: 0 in 0.422s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:58 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99 Sep 10 18:27:58 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:59 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c00945a5-dc65-4af1-88b3-3cd99914cd03 1073741824" returned: 0 in 0.573s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:59 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-d37faf38-fc98-470d-a740-782ea115e149 req-0606451f-7237-4bd6-8f45-a0ce447499c2 tempest-TestInstancesWithCinderVolumes-1476110052 None] Terminate volume connection completed successfully. Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-d37faf38-fc98-470d-a740-782ea115e149 req-0606451f-7237-4bd6-8f45-a0ce447499c2 tempest-TestInstancesWithCinderVolumes-1476110052 None] Deleting attachment 9303a25f-7813-4cc4-8d2a-d36ecc943bf8. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c00945a5-dc65-4af1-88b3-3cd99914cd03 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:59 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c00945a5-dc65-4af1-88b3-3cd99914cd03 Sep 10 18:27:59 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:59 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55.6519ab3c-f5f9-469d-94a7-5ddbd53c0a99" returned: 0 in 0.344s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-6519ab3c-f5f9-469d-94a7-5ddbd53c0a99" released by "_delete_snapshot" :: held 2.087s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-afe7968e-9947-40b4-ad99-214c93fced55" released by "delete_snapshot" :: held 2.116s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Created reservations ['2d73a4ff-9ed5-4bee-80e4-bc1d65ae9839', '668c7e38-ccbb-4c94-b947-262f96f0a685', 'c7f63fc7-3a1c-47fa-aef9-587c20a5dc5d', 'ef78ce2f-6217-47a5-9d55-79f390505e21'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:27:59 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c00945a5-dc65-4af1-88b3-3cd99914cd03" returned: 0 in 0.349s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafc36e8-e743-4d8a-9bd5-38092b4cd968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c00945a5-dc65-4af1-88b3-3cd99914cd03', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09b2db2-0df0-412f-aad1-b355513304ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:27:59 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Delete snapshot completed successfully. Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-6519ab3c-f5f9-469d-94a7-5ddbd53c0a99-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Snapshots deleted, issuing volume delete {{(pid=87842) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "cinder-quobyte-afe7968e-9947-40b4-ad99-214c93fced55" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:59 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Volume volume-c00945a5-dc65-4af1-88b3-3cd99914cd03 (c00945a5-dc65-4af1-88b3-3cd99914cd03): created successfully Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09b2db2-0df0-412f-aad1-b355513304ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Flow 'volume_create_manager' (e4cbbaa9-f072-45cd-bddb-2ed44d1619d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-afe7968e-9947-40b4-ad99-214c93fced55" acquired by "delete_volume" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:59 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-857d9b8d-68af-410f-8aaa-9b7b67692b75 tempest-VolumesTestJSON-196246865 None] Created volume successfully. Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6531c68d-1d4a-4f34-ac19-86953eabe114]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:27:59 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55 Sep 10 18:27:59 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] Acquiring lock "cinder-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "cinder-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] Acquiring lock "cinder-quobyte-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "cinder-quobyte-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64" acquired by "delete_volume" :: waited 0.027s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[25443242-68b8-4eae-ac75-2c1b194c17b3]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:27:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:00 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55" returned: 0 in 0.471s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:00 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55 Sep 10 18:28:00 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:00 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64 Sep 10 18:28:00 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:00 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-afe7968e-9947-40b4-ad99-214c93fced55" returned: 0 in 0.364s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:00 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64" returned: 0 in 0.475s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-afe7968e-9947-40b4-ad99-214c93fced55" released by "delete_volume" :: held 0.949s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:00 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64 Sep 10 18:28:00 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:00 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Created reservations ['6b8930cf-2a5b-469f-8b52-60712c32c782', 'feb4daa6-347c-4871-98b0-831ac0be8cb6', 'fa433b23-3e83-4faa-a9af-c7f820175f45', '7d4c40f5-9136-4af8-9743-705b0c262531'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:00 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:00 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:00 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:00 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:00 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64" returned: 0 in 0.370s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "cinder-quobyte-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64" released by "delete_volume" :: held 0.913s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:00 devstack cinder-volume[87842]: WARNING cinder.quota [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1011858151-1851826863 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1011858151-1851826863, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:28:00 devstack cinder-volume[87842]: WARNING cinder.quota [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1011858151-1851826863 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1011858151-1851826863, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:28:00 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] Created reservations ['65ff256b-7872-40db-bb80-4fafbe087bc2', 'a28f6e27-3a80-437d-82f1-60c078f53f42', 'be7a2f94-d71b-4732-944c-a4d7b1055b44', '1221aaaf-2686-45eb-ade6-b3462161f522'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:01 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:01 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:01 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.511s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:01 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Deleted volume successfully. Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-095a9e60-511a-4b12-8460-a9b44ba8cc75 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-afe7968e-9947-40b4-ad99-214c93fced55-delete_volume" released by "delete_volume" :: held 4.167s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:01 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.397s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:01 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] Deleted volume successfully. Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Flow 'volume_create_manager' (7dff7dc3-57ad-4a29-be73-a09f61c008d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b73ecfc-75b1-49b5-a4b8-cd8d4693cb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a4c1f7ac-020e-4434-a8f1-167ad995d2b5 tempest-BackendsCapabilitiesAdminTestsJSON-1126154734 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2273559570312, 'free_capacity_gb': 1773.2273559570312, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87842) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-187cfe1a-e361-46f8-931c-d29c81a9f02c tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "cinder-9524d51f-c6d6-4f6a-a7af-fdeb5a6f3a64-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b73ecfc-75b1-49b5-a4b8-cd8d4693cb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-809769657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81370d4-4561-455d-8604-991be6189730,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='432700ad4aea4ea78f50aed60115550b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:01Z,use_quota=True,user_id='e42f863c4c6a43afbb9096742bca5427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d1421d-a2f2-4ec9-9a26-80c324df3dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d1421d-a2f2-4ec9-9a26-80c324df3dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e10420b-3710-40e8-b87e-8dd5f825e39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e10420b-3710-40e8-b87e-8dd5f825e39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f81370d4-4561-455d-8604-991be6189730', 'volume_name': 'volume-f81370d4-4561-455d-8604-991be6189730', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e61222-8128-41d1-9d84-5826a8411241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e61222-8128-41d1-9d84-5826a8411241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb31333-9344-43e9-8445-4b1a222ebbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:01 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Volume f81370d4-4561-455d-8604-991be6189730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f81370d4-4561-455d-8604-991be6189730', 'volume_size': 1} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-809769657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81370d4-4561-455d-8604-991be6189730,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='432700ad4aea4ea78f50aed60115550b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:01Z,use_quota=True,user_id='e42f863c4c6a43afbb9096742bca5427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Creating volume f81370d4-4561-455d-8604-991be6189730 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:28:01 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f81370d4-4561-455d-8604-991be6189730 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8bdee3a5-b558-45f0-9e7b-dceb6abd9420 tempest-BackendsCapabilitiesAdminTestsJSON-1126154734 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2273559570312, 'free_capacity_gb': 1773.2273559570312, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87842) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 10 18:28:01 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f81370d4-4561-455d-8604-991be6189730 1073741824 Sep 10 18:28:01 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "cinder-747bf5b4-1974-4d31-867c-e70e556c31bc-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-747bf5b4-1974-4d31-867c-e70e556c31bc-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "cinder-quobyte-747bf5b4-1974-4d31-867c-e70e556c31bc" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-747bf5b4-1974-4d31-867c-e70e556c31bc" acquired by "delete_volume" :: waited 0.036s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f86a60-4671-426b-b977-4bb4413903d1]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-747bf5b4-1974-4d31-867c-e70e556c31bc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:02 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-747bf5b4-1974-4d31-867c-e70e556c31bc Sep 10 18:28:02 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:02 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f81370d4-4561-455d-8604-991be6189730 1073741824" returned: 0 in 0.650s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f81370d4-4561-455d-8604-991be6189730 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:02 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f81370d4-4561-455d-8604-991be6189730 Sep 10 18:28:02 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:02 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-747bf5b4-1974-4d31-867c-e70e556c31bc" returned: 0 in 0.581s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-747bf5b4-1974-4d31-867c-e70e556c31bc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:02 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-747bf5b4-1974-4d31-867c-e70e556c31bc Sep 10 18:28:02 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:02 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f81370d4-4561-455d-8604-991be6189730" returned: 0 in 0.291s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:28:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb31333-9344-43e9-8445-4b1a222ebbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f81370d4-4561-455d-8604-991be6189730', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd81a8fd-5743-442c-b254-9fd03b848893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:02 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Volume volume-f81370d4-4561-455d-8604-991be6189730 (f81370d4-4561-455d-8604-991be6189730): created successfully Sep 10 18:28:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd81a8fd-5743-442c-b254-9fd03b848893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Flow 'volume_create_manager' (7dff7dc3-57ad-4a29-be73-a09f61c008d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:02 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-12ad85c2-051b-46c0-b3fd-8ac40282b5fa tempest-VolumesTestJSON-196246865 None] Created volume successfully. Sep 10 18:28:02 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-747bf5b4-1974-4d31-867c-e70e556c31bc" returned: 0 in 0.340s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-quobyte-747bf5b4-1974-4d31-867c-e70e556c31bc" released by "delete_volume" :: held 1.002s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:03 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] Created reservations ['f470c229-e264-4cc7-91ff-96cf24562504', 'ec609132-254e-45d3-966b-3b00f6a445cc', '062de995-93fc-420d-98c5-4d23694f35dc', 'b881b9c3-2490-44cd-a567-1fd3184fe58c'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:03 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:03 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:03 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.449s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:03 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:03 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] Deleted volume successfully. Sep 10 18:28:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-139fb10a-70a5-4716-9a3d-af9b10fe0ad8 tempest-VolumesDeleteCascade-2050521027 None] Lock "cinder-747bf5b4-1974-4d31-867c-e70e556c31bc-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:05 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] Acquiring lock "cinder-f81370d4-4561-455d-8604-991be6189730-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:05 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] Lock "cinder-f81370d4-4561-455d-8604-991be6189730-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:05 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] Acquiring lock "cinder-quobyte-f81370d4-4561-455d-8604-991be6189730" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:05 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] Lock "cinder-quobyte-f81370d4-4561-455d-8604-991be6189730" acquired by "delete_volume" :: waited 0.042s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:05 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd3a44b-6db6-4a00-b254-205ae1fd169b]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f81370d4-4561-455d-8604-991be6189730 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:05 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f81370d4-4561-455d-8604-991be6189730 Sep 10 18:28:05 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:05 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-599e44e2-589d-4ecc-b95e-7bb6c3904b70 req-59cb78ed-8f9b-4a96-add7-c7bb5bac905b tempest-TestInstancesWithCinderVolumes-1476110052 None] Terminate volume connection completed successfully. Sep 10 18:28:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-599e44e2-589d-4ecc-b95e-7bb6c3904b70 req-59cb78ed-8f9b-4a96-add7-c7bb5bac905b tempest-TestInstancesWithCinderVolumes-1476110052 None] Deleting attachment 7327e135-df1e-4b07-b0cc-977a746a9273. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:28:06 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f81370d4-4561-455d-8604-991be6189730" returned: 0 in 0.553s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f81370d4-4561-455d-8604-991be6189730 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:06 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f81370d4-4561-455d-8604-991be6189730 Sep 10 18:28:06 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:06 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f81370d4-4561-455d-8604-991be6189730" returned: 0 in 0.329s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:06 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] Lock "cinder-quobyte-f81370d4-4561-455d-8604-991be6189730" released by "delete_volume" :: held 0.967s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:06 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] Created reservations ['2cee975e-3bd1-423e-b0ae-9d4aa20ad13e', 'e11774fc-ce59-4f01-8713-7c6d49ba25d3', 'df0172a9-fd46-4214-8aa5-ffdb67015844', 'd12ad407-0227-4e08-b988-4ac6882f5bd7'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:06 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:06 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:06 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:06 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:06 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.318s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:06 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:06 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] Deleted volume successfully. Sep 10 18:28:06 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-292e513e-f863-4afa-aa25-5806aeaaccf9 tempest-VolumesTestJSON-196246865 None] Lock "cinder-f81370d4-4561-455d-8604-991be6189730-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:06 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] Acquiring lock "cinder-a9813e20-a161-4d18-ba03-3c758585eb6b-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:06 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "cinder-a9813e20-a161-4d18-ba03-3c758585eb6b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] Acquiring lock "cinder-quobyte-a9813e20-a161-4d18-ba03-3c758585eb6b" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "cinder-quobyte-a9813e20-a161-4d18-ba03-3c758585eb6b" acquired by "delete_volume" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:07 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[64288e80-9cf6-434c-9694-4b658a23e848]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9813e20-a161-4d18-ba03-3c758585eb6b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:07 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9813e20-a161-4d18-ba03-3c758585eb6b Sep 10 18:28:07 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:07 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9813e20-a161-4d18-ba03-3c758585eb6b" returned: 0 in 0.407s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9813e20-a161-4d18-ba03-3c758585eb6b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:07 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9813e20-a161-4d18-ba03-3c758585eb6b Sep 10 18:28:07 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] Acquiring lock "cinder-c00945a5-dc65-4af1-88b3-3cd99914cd03-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] Lock "cinder-c00945a5-dc65-4af1-88b3-3cd99914cd03-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] Acquiring lock "cinder-quobyte-c00945a5-dc65-4af1-88b3-3cd99914cd03" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] Lock "cinder-quobyte-c00945a5-dc65-4af1-88b3-3cd99914cd03" acquired by "delete_volume" :: waited 0.020s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:07 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9813e20-a161-4d18-ba03-3c758585eb6b" returned: 0 in 0.358s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "cinder-quobyte-a9813e20-a161-4d18-ba03-3c758585eb6b" released by "delete_volume" :: held 0.832s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:07 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8d18dc-797b-4c6d-9b40-8ed7a8d12117]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c00945a5-dc65-4af1-88b3-3cd99914cd03 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:07 devstack cinder-volume[87842]: WARNING cinder.quota [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-122311828-1200413054 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-122311828-1200413054, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:28:07 devstack cinder-volume[87842]: WARNING cinder.quota [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-122311828-1200413054 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-122311828-1200413054, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:28:07 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] Created reservations ['a1b15fb9-4f0a-488a-96ff-e972ea9ee289', 'd7d507ff-c8cd-4413-9e6f-71a3cdfe23ca', '2bee69e3-e911-4441-962e-4ef12ca12a0a', 'dca4a4db-f188-481a-a395-20bb7866dd94'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:08 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c00945a5-dc65-4af1-88b3-3cd99914cd03 Sep 10 18:28:08 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:08 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:08 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:08 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.329s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:08 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:08 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] Deleted volume successfully. Sep 10 18:28:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e82791cc-f67e-4bad-9d3e-c63b1e25578e tempest-TestInstancesWithCinderVolumes-1476110052 None] Lock "cinder-a9813e20-a161-4d18-ba03-3c758585eb6b-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:08 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c00945a5-dc65-4af1-88b3-3cd99914cd03" returned: 0 in 0.615s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c00945a5-dc65-4af1-88b3-3cd99914cd03 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:08 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c00945a5-dc65-4af1-88b3-3cd99914cd03 Sep 10 18:28:08 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:08 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c00945a5-dc65-4af1-88b3-3cd99914cd03" returned: 0 in 0.298s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] Lock "cinder-quobyte-c00945a5-dc65-4af1-88b3-3cd99914cd03" released by "delete_volume" :: held 0.999s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:08 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] Created reservations ['fbbdedff-5ef8-4bc2-81c2-cc70afda4b46', 'b509f5ca-6734-4f10-9cf5-c720b975faa5', '0c2a07e3-0114-45cb-baad-c13ab4a59c0a', 'de718ed7-2990-4cc9-8588-5847a1a7cdb1'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:09 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:09 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:09 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.316s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:09 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:09 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] Deleted volume successfully. Sep 10 18:28:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c32d9de1-9eb8-444f-b3b8-a204b6d4a11c tempest-VolumesTestJSON-196246865 None] Lock "cinder-c00945a5-dc65-4af1-88b3-3cd99914cd03-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] Acquiring lock "cinder-2f245e0a-ccc1-479e-b535-c146a420db1a-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] Lock "cinder-2f245e0a-ccc1-479e-b535-c146a420db1a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] Acquiring lock "cinder-quobyte-2f245e0a-ccc1-479e-b535-c146a420db1a" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] Lock "cinder-quobyte-2f245e0a-ccc1-479e-b535-c146a420db1a" acquired by "delete_volume" :: waited 0.015s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b8df90-9086-4ca5-93c1-ff4aca3d129d]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2f245e0a-ccc1-479e-b535-c146a420db1a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:10 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-0eda8a1a-05ff-4a3d-9176-26953d345ca1 tempest-GroupsTest-77964215 None] Group tempest-Group1-1723983894: creating Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Flow 'volume_create_manager' (7083f677-6af9-4fbd-8786-d605ac244e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041887f6-a7bd-47f5-b48e-c1ed2a566d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041887f6-a7bd-47f5-b48e-c1ed2a566d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1298192606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e02e0d-252b-4846-b6f9-f6c50e827373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1969d585db5149eaacef8c1240a80ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:10Z,use_quota=True,user_id='08dca44a4cc14f0083ee38c8dff85c8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd643b1-51c6-4f44-b85f-cb9685bef887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd643b1-51c6-4f44-b85f-cb9685bef887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:10 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2f245e0a-ccc1-479e-b535-c146a420db1a Sep 10 18:28:10 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc1432c-5301-43ee-8927-dca67f7b3fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc1432c-5301-43ee-8927-dca67f7b3fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9e02e0d-252b-4846-b6f9-f6c50e827373', 'volume_name': 'volume-a9e02e0d-252b-4846-b6f9-f6c50e827373', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87765ca9-b05a-4ff3-b3e1-8382a24df783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87765ca9-b05a-4ff3-b3e1-8382a24df783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c814d5e-99dc-41b9-be10-de205fb6f1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:10 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Volume a9e02e0d-252b-4846-b6f9-f6c50e827373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9e02e0d-252b-4846-b6f9-f6c50e827373', 'volume_size': 1} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1298192606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e02e0d-252b-4846-b6f9-f6c50e827373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1969d585db5149eaacef8c1240a80ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:10Z,use_quota=True,user_id='08dca44a4cc14f0083ee38c8dff85c8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Creating volume a9e02e0d-252b-4846-b6f9-f6c50e827373 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:28:10 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9e02e0d-252b-4846-b6f9-f6c50e827373 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:10 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-0eda8a1a-05ff-4a3d-9176-26953d345ca1 tempest-GroupsTest-77964215 None] Group tempest-Group1-1723983894: created successfully Sep 10 18:28:10 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9e02e0d-252b-4846-b6f9-f6c50e827373 1073741824 Sep 10 18:28:10 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-0eda8a1a-05ff-4a3d-9176-26953d345ca1 tempest-GroupsTest-77964215 None] Create group completed successfully. Sep 10 18:28:10 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:10 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2f245e0a-ccc1-479e-b535-c146a420db1a" returned: 0 in 0.465s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2f245e0a-ccc1-479e-b535-c146a420db1a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:10 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2f245e0a-ccc1-479e-b535-c146a420db1a Sep 10 18:28:10 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:10 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9e02e0d-252b-4846-b6f9-f6c50e827373 1073741824" returned: 0 in 0.479s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9e02e0d-252b-4846-b6f9-f6c50e827373 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:11 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9e02e0d-252b-4846-b6f9-f6c50e827373 Sep 10 18:28:11 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:11 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2f245e0a-ccc1-479e-b535-c146a420db1a" returned: 0 in 0.275s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] Lock "cinder-quobyte-2f245e0a-ccc1-479e-b535-c146a420db1a" released by "delete_volume" :: held 0.798s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] Created reservations ['f150d142-b887-49d0-8eda-b15b4594c99d', 'd7a664a3-f36e-4c8a-ae5e-e7076b2fb1e2', '09008340-6b29-4a1b-9708-8b5ed6af391c', '02a8330f-64f1-4d70-b8e6-8e9b05bd90f0'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:11 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9e02e0d-252b-4846-b6f9-f6c50e827373" returned: 0 in 0.278s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:11 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:11 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c814d5e-99dc-41b9-be10-de205fb6f1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9e02e0d-252b-4846-b6f9-f6c50e827373', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2acc17-3844-4715-bdc4-d42cd6fca886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:11 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Volume volume-a9e02e0d-252b-4846-b6f9-f6c50e827373 (a9e02e0d-252b-4846-b6f9-f6c50e827373): created successfully Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2acc17-3844-4715-bdc4-d42cd6fca886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Flow 'volume_create_manager' (7083f677-6af9-4fbd-8786-d605ac244e76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:11 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d37d2ae3-5539-4da1-ae71-193930e2e6a7 tempest-VolumesMetadataTest-1917359026 None] Created volume successfully. Sep 10 18:28:11 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ab3058ad-adf6-4a34-a2e4-d53a4ba38e43 tempest-GroupsTest-77964215 None] Group tempest-Group2-1330325382: creating Sep 10 18:28:11 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ab3058ad-adf6-4a34-a2e4-d53a4ba38e43 tempest-GroupsTest-77964215 None] Group tempest-Group2-1330325382: created successfully Sep 10 18:28:11 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.280s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:11 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ab3058ad-adf6-4a34-a2e4-d53a4ba38e43 tempest-GroupsTest-77964215 None] Create group completed successfully. Sep 10 18:28:11 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] Deleted volume successfully. Sep 10 18:28:11 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2b930daa-e3e2-431a-9a52-cae15c7410ba tempest-VolumesTestJSON-196246865 None] Lock "cinder-2f245e0a-ccc1-479e-b535-c146a420db1a-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Flow 'volume_create_manager' (95a3fd85-7654-4a85-b1c3-5c523b2184b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea8ca2d-7e6e-4f56-8a54-c05e11dd8d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea8ca2d-7e6e-4f56-8a54-c05e11dd8d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-732139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f8d7ec4c-ea92-4c0e-80ff-150895019ac9,host='devstack@QuobyteHD#QuobyteHD',id=6886f824-e488-4607-93dd-fe371754c05a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187c586d1d8b431dbf607f5bc1892a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:13Z,use_quota=True,user_id='1efbe69d7fec41719c21c2f9972e6a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(241b5832-2e07-4a0b-82ec-d558ff92c95d),volume_type_id=241b5832-2e07-4a0b-82ec-d558ff92c95d)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd98fce2-e1be-416e-a7f4-c86b2359f778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd98fce2-e1be-416e-a7f4-c86b2359f778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ef7828-7ebb-406b-b1e9-ca389d05cc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ef7828-7ebb-406b-b1e9-ca389d05cc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6886f824-e488-4607-93dd-fe371754c05a', 'volume_name': 'volume-6886f824-e488-4607-93dd-fe371754c05a', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cace86d-2820-4977-89ef-322e084d6823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cace86d-2820-4977-89ef-322e084d6823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2867631a-7c12-4a06-bb81-62650906eb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:13 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Volume 6886f824-e488-4607-93dd-fe371754c05a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6886f824-e488-4607-93dd-fe371754c05a', 'volume_size': 1} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f8d7ec4c-ea92-4c0e-80ff-150895019ac9,created_at=2026-09-10T16:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-732139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f8d7ec4c-ea92-4c0e-80ff-150895019ac9,host='devstack@QuobyteHD#QuobyteHD',id=6886f824-e488-4607-93dd-fe371754c05a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187c586d1d8b431dbf607f5bc1892a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:13Z,use_quota=True,user_id='1efbe69d7fec41719c21c2f9972e6a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(241b5832-2e07-4a0b-82ec-d558ff92c95d),volume_type_id=241b5832-2e07-4a0b-82ec-d558ff92c95d)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Creating volume 6886f824-e488-4607-93dd-fe371754c05a {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:28:13 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6886f824-e488-4607-93dd-fe371754c05a 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] Acquiring lock "cinder-a9e02e0d-252b-4846-b6f9-f6c50e827373-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:13 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6886f824-e488-4607-93dd-fe371754c05a 1073741824 Sep 10 18:28:13 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] Lock "cinder-a9e02e0d-252b-4846-b6f9-f6c50e827373-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] Acquiring lock "cinder-quobyte-a9e02e0d-252b-4846-b6f9-f6c50e827373" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] Lock "cinder-quobyte-a9e02e0d-252b-4846-b6f9-f6c50e827373" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bd0454-acb8-442b-a10c-c07236f8f240]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9e02e0d-252b-4846-b6f9-f6c50e827373 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:14 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9e02e0d-252b-4846-b6f9-f6c50e827373 Sep 10 18:28:14 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:14 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9e02e0d-252b-4846-b6f9-f6c50e827373" returned: 0 in 0.431s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9e02e0d-252b-4846-b6f9-f6c50e827373 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:14 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6886f824-e488-4607-93dd-fe371754c05a 1073741824" returned: 0 in 0.653s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:14 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9e02e0d-252b-4846-b6f9-f6c50e827373 Sep 10 18:28:14 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6886f824-e488-4607-93dd-fe371754c05a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:14 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6886f824-e488-4607-93dd-fe371754c05a Sep 10 18:28:14 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:14 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9e02e0d-252b-4846-b6f9-f6c50e827373" returned: 0 in 0.308s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] Lock "cinder-quobyte-a9e02e0d-252b-4846-b6f9-f6c50e827373" released by "delete_volume" :: held 0.801s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:14 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6886f824-e488-4607-93dd-fe371754c05a" returned: 0 in 0.278s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2867631a-7c12-4a06-bb81-62650906eb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6886f824-e488-4607-93dd-fe371754c05a', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b204a7b6-84e6-4749-8bcb-5534285ca907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] Created reservations ['f5fc40f6-d311-433c-b984-3bb9784b9c89', '51fd4c60-4e08-43ee-9885-610d2a6a2710', '96e752d4-66ab-432f-bd02-550654bda1e0', '0a92bd0e-c0ca-41f9-9112-95e79e6c0b17'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:14 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Volume volume-6886f824-e488-4607-93dd-fe371754c05a (6886f824-e488-4607-93dd-fe371754c05a): created successfully Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b204a7b6-84e6-4749-8bcb-5534285ca907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Flow 'volume_create_manager' (95a3fd85-7654-4a85-b1c3-5c523b2184b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:14 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4d8d0939-7686-4d21-854a-71a2350ff443 tempest-GroupsTest-77964215 None] Created volume successfully. Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:14 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:14 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:15 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.275s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:15 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:15 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] Deleted volume successfully. Sep 10 18:28:15 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ac851ca4-bfa3-4655-b0bf-b71f7fe6ce07 tempest-VolumesMetadataTest-1917359026 None] Lock "cinder-a9e02e0d-252b-4846-b6f9-f6c50e827373-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] Acquiring lock "cinder-quobyte-6886f824-e488-4607-93dd-fe371754c05a" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] Lock "cinder-quobyte-6886f824-e488-4607-93dd-fe371754c05a" acquired by "delete_volume" :: waited 0.028s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:16 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0718369f-8aa6-4309-b723-30d87c665eee]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6886f824-e488-4607-93dd-fe371754c05a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:17 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6886f824-e488-4607-93dd-fe371754c05a Sep 10 18:28:17 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:17 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e3c378a8-d5cd-4bcb-aee1-dd6acf088c98 tempest-GroupsV320Test-1624570075 None] Group tempest-GroupsV320Test-Group-915628114: creating Sep 10 18:28:17 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e3c378a8-d5cd-4bcb-aee1-dd6acf088c98 tempest-GroupsV320Test-1624570075 None] Group tempest-GroupsV320Test-Group-915628114: created successfully Sep 10 18:28:17 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e3c378a8-d5cd-4bcb-aee1-dd6acf088c98 tempest-GroupsV320Test-1624570075 None] Create group completed successfully. Sep 10 18:28:17 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6886f824-e488-4607-93dd-fe371754c05a" returned: 0 in 0.394s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6886f824-e488-4607-93dd-fe371754c05a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:17 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6886f824-e488-4607-93dd-fe371754c05a Sep 10 18:28:17 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:17 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6886f824-e488-4607-93dd-fe371754c05a" returned: 0 in 0.292s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] Lock "cinder-quobyte-6886f824-e488-4607-93dd-fe371754c05a" released by "delete_volume" :: held 0.759s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:17 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] Created reservations ['877449b8-d319-4dfe-8e6c-193cae6bb648'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:17 devstack cinder-volume[87842]: WARNING cinder.quota [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2069613328 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2069613328, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:28:17 devstack cinder-volume[87842]: WARNING cinder.quota [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2069613328 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2069613328, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:28:17 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] Created reservations ['ed55f1d4-1a4f-4819-b13f-807a488e6e54', '6c4657a0-bc84-4d49-b16a-b0c3d96653e8', '4bf90f42-fefb-4a21-a62f-482dcfeb79c1', '5272cfaa-8df8-49e9-9c08-b1e369687d72'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:18 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:18 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:18 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.288s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:18 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:18 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-a5bcd8a1-3a74-40fb-936d-f21158268fab tempest-GroupsTest-77964215 None] Delete group completed successfully. Sep 10 18:28:18 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-0d18b031-bffd-4d46-818a-3e98111defd7 tempest-GroupsTest-77964215 None] Created reservations ['34f2c308-85e3-4a69-93f1-d179f726841d'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0d18b031-bffd-4d46-818a-3e98111defd7 tempest-GroupsTest-77964215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0d18b031-bffd-4d46-818a-3e98111defd7 tempest-GroupsTest-77964215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0d18b031-bffd-4d46-818a-3e98111defd7 tempest-GroupsTest-77964215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0d18b031-bffd-4d46-818a-3e98111defd7 tempest-GroupsTest-77964215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0d18b031-bffd-4d46-818a-3e98111defd7 tempest-GroupsTest-77964215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0d18b031-bffd-4d46-818a-3e98111defd7 tempest-GroupsTest-77964215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:18 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:18 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:18 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0d18b031-bffd-4d46-818a-3e98111defd7 tempest-GroupsTest-77964215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.323s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:18 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-0d18b031-bffd-4d46-818a-3e98111defd7 tempest-GroupsTest-77964215 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:18 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-0d18b031-bffd-4d46-818a-3e98111defd7 tempest-GroupsTest-77964215 None] Delete group completed successfully. Sep 10 18:28:18 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-aa3bebe3-5a1d-463a-af93-7cba107710a1 tempest-GroupsV320Test-1624570075 None] Created reservations ['8b2c8442-521e-4f9e-aa37-8aaab1dd8b54'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aa3bebe3-5a1d-463a-af93-7cba107710a1 tempest-GroupsV320Test-1624570075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aa3bebe3-5a1d-463a-af93-7cba107710a1 tempest-GroupsV320Test-1624570075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-aa3bebe3-5a1d-463a-af93-7cba107710a1 tempest-GroupsV320Test-1624570075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-aa3bebe3-5a1d-463a-af93-7cba107710a1 tempest-GroupsV320Test-1624570075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aa3bebe3-5a1d-463a-af93-7cba107710a1 tempest-GroupsV320Test-1624570075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-aa3bebe3-5a1d-463a-af93-7cba107710a1 tempest-GroupsV320Test-1624570075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:19 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:19 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:19 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-aa3bebe3-5a1d-463a-af93-7cba107710a1 tempest-GroupsV320Test-1624570075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.272s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-aa3bebe3-5a1d-463a-af93-7cba107710a1 tempest-GroupsV320Test-1624570075 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:19 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-aa3bebe3-5a1d-463a-af93-7cba107710a1 tempest-GroupsV320Test-1624570075 None] Delete group completed successfully. Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Flow 'volume_create_manager' (a271f9f2-7b58-4078-ab9e-21323697304b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b8221e-57db-4699-87c0-cad42f7eb4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b8221e-57db-4699-87c0-cad42f7eb4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1976669394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7d1bd6-96f0-4a18-b798-67e0196ada28,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e20964ae34a24e53a761285adfa44fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:20Z,use_quota=True,user_id='b52c4aee3e464577882f22cf85158e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8fb896-1c7c-44ea-be37-db6fefdf1069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8fb896-1c7c-44ea-be37-db6fefdf1069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f36aa9-eff2-4ba2-9336-4dc4db5bda92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f36aa9-eff2-4ba2-9336-4dc4db5bda92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce7d1bd6-96f0-4a18-b798-67e0196ada28', 'volume_name': 'volume-ce7d1bd6-96f0-4a18-b798-67e0196ada28', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2619861a-ada7-4fc1-a290-0e34cff1cc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2619861a-ada7-4fc1-a290-0e34cff1cc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c35d3b-c3dd-42e9-b0b0-0c9c7e784cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:19 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Volume ce7d1bd6-96f0-4a18-b798-67e0196ada28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce7d1bd6-96f0-4a18-b798-67e0196ada28', 'volume_size': 1} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1976669394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7d1bd6-96f0-4a18-b798-67e0196ada28,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e20964ae34a24e53a761285adfa44fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:20Z,use_quota=True,user_id='b52c4aee3e464577882f22cf85158e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Creating volume ce7d1bd6-96f0-4a18-b798-67e0196ada28 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:28:19 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:28:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce7d1bd6-96f0-4a18-b798-67e0196ada28 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:19 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce7d1bd6-96f0-4a18-b798-67e0196ada28 1073741824 Sep 10 18:28:19 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:20 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-fd54dd83-1872-4608-b031-d2c03cbbb93b tempest-GroupsTest-77964215 None] Group tempest-GroupsTest-Group-1684284385: creating Sep 10 18:28:20 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-fd54dd83-1872-4608-b031-d2c03cbbb93b tempest-GroupsTest-77964215 None] Group tempest-GroupsTest-Group-1684284385: created successfully Sep 10 18:28:20 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-fd54dd83-1872-4608-b031-d2c03cbbb93b tempest-GroupsTest-77964215 None] Create group completed successfully. Sep 10 18:28:20 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce7d1bd6-96f0-4a18-b798-67e0196ada28 1073741824" returned: 0 in 0.555s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce7d1bd6-96f0-4a18-b798-67e0196ada28 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:20 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce7d1bd6-96f0-4a18-b798-67e0196ada28 Sep 10 18:28:20 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:20 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce7d1bd6-96f0-4a18-b798-67e0196ada28" returned: 0 in 0.267s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:28:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c35d3b-c3dd-42e9-b0b0-0c9c7e784cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce7d1bd6-96f0-4a18-b798-67e0196ada28', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a226a40-3929-470e-977d-88fae6827328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:20 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Volume volume-ce7d1bd6-96f0-4a18-b798-67e0196ada28 (ce7d1bd6-96f0-4a18-b798-67e0196ada28): created successfully Sep 10 18:28:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a226a40-3929-470e-977d-88fae6827328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Flow 'volume_create_manager' (a271f9f2-7b58-4078-ab9e-21323697304b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:20 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c21175db-54d1-46ce-a0cf-b01f9d4ed3be tempest-VolumesGetTest-1191421110 None] Created volume successfully. Sep 10 18:28:21 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:28:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Flow 'volume_create_manager' (8d6d0848-3d8a-4f40-8926-28cc4b350ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b0d1e3-1de4-47c7-b3d7-398bc5bd700b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b0d1e3-1de4-47c7-b3d7-398bc5bd700b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1219638990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c89976e-71c4-4974-90b8-39527adb3f4b,host='devstack@QuobyteHD#QuobyteHD',id=16b804f2-0647-448d-918d-52a65a1ec11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187c586d1d8b431dbf607f5bc1892a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:22Z,use_quota=True,user_id='1efbe69d7fec41719c21c2f9972e6a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dd7ce8-eada-4ca7-a7b1-2892405f0f6a),volume_type_id=b2dd7ce8-eada-4ca7-a7b1-2892405f0f6a)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da58369-8730-4619-a015-2894f58ce05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da58369-8730-4619-a015-2894f58ce05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8498143f-11b9-4a59-b8d2-b82b766ea902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8498143f-11b9-4a59-b8d2-b82b766ea902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16b804f2-0647-448d-918d-52a65a1ec11e', 'volume_name': 'volume-16b804f2-0647-448d-918d-52a65a1ec11e', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdf335b-9f25-4ef6-ab08-6b4549215b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdf335b-9f25-4ef6-ab08-6b4549215b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df01be41-c865-4b46-8cd5-85820222881c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:21 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Volume 16b804f2-0647-448d-918d-52a65a1ec11e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16b804f2-0647-448d-918d-52a65a1ec11e', 'volume_size': 1} Sep 10 18:28:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c89976e-71c4-4974-90b8-39527adb3f4b,created_at=2026-09-10T16:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1219638990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c89976e-71c4-4974-90b8-39527adb3f4b,host='devstack@QuobyteHD#QuobyteHD',id=16b804f2-0647-448d-918d-52a65a1ec11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187c586d1d8b431dbf607f5bc1892a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:22Z,use_quota=True,user_id='1efbe69d7fec41719c21c2f9972e6a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dd7ce8-eada-4ca7-a7b1-2892405f0f6a),volume_type_id=b2dd7ce8-eada-4ca7-a7b1-2892405f0f6a)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:28:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Creating volume 16b804f2-0647-448d-918d-52a65a1ec11e {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:28:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:28:22 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:28:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16b804f2-0647-448d-918d-52a65a1ec11e 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:22 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16b804f2-0647-448d-918d-52a65a1ec11e 1073741824 Sep 10 18:28:22 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:22 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16b804f2-0647-448d-918d-52a65a1ec11e 1073741824" returned: 0 in 0.565s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16b804f2-0647-448d-918d-52a65a1ec11e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:22 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16b804f2-0647-448d-918d-52a65a1ec11e Sep 10 18:28:22 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:23 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16b804f2-0647-448d-918d-52a65a1ec11e" returned: 0 in 0.421s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df01be41-c865-4b46-8cd5-85820222881c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16b804f2-0647-448d-918d-52a65a1ec11e', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32848f08-32be-49d6-b5c5-451cb24053e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:23 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Volume volume-16b804f2-0647-448d-918d-52a65a1ec11e (16b804f2-0647-448d-918d-52a65a1ec11e): created successfully Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32848f08-32be-49d6-b5c5-451cb24053e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Flow 'volume_create_manager' (8d6d0848-3d8a-4f40-8926-28cc4b350ed1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Flow 'volume_create_manager' (86559c2a-0c88-4286-b780-6c13f46cf0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9901098-5de9-4d59-aef7-5f95fa2fdea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9901098-5de9-4d59-aef7-5f95fa2fdea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-323423473',display_name='tempest-VolumesGetTest-Volume-870677961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6cfa46-e4de-401c-a9e2-432f8ff905a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20964ae34a24e53a761285adfa44fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:23Z,use_quota=True,user_id='b52c4aee3e464577882f22cf85158e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4f246f-395a-4c8f-9aac-eb7a59e16a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4f246f-395a-4c8f-9aac-eb7a59e16a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f50d826-6b22-4f4d-a981-c68e44f2b3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f50d826-6b22-4f4d-a981-c68e44f2b3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a6cfa46-e4de-401c-a9e2-432f8ff905a4', 'volume_name': 'volume-0a6cfa46-e4de-401c-a9e2-432f8ff905a4', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56683c65-a28e-4c6e-8441-44c85f42d3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56683c65-a28e-4c6e-8441-44c85f42d3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d56f50-77db-4301-9105-b7bb597b78a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:23 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Volume 0a6cfa46-e4de-401c-a9e2-432f8ff905a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a6cfa46-e4de-401c-a9e2-432f8ff905a4', 'volume_size': 1} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-323423473',display_name='tempest-VolumesGetTest-Volume-870677961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6cfa46-e4de-401c-a9e2-432f8ff905a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20964ae34a24e53a761285adfa44fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:23Z,use_quota=True,user_id='b52c4aee3e464577882f22cf85158e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Creating volume 0a6cfa46-e4de-401c-a9e2-432f8ff905a4 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:28:23 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0a6cfa46-e4de-401c-a9e2-432f8ff905a4 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:23 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-51563410-8edd-4878-91b6-c54e2ee3954b tempest-GroupsTest-77964215 None] Created volume successfully. Sep 10 18:28:23 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0a6cfa46-e4de-401c-a9e2-432f8ff905a4 1073741824 Sep 10 18:28:23 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:23 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0a6cfa46-e4de-401c-a9e2-432f8ff905a4 1073741824" returned: 0 in 0.500s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0a6cfa46-e4de-401c-a9e2-432f8ff905a4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:23 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0a6cfa46-e4de-401c-a9e2-432f8ff905a4 Sep 10 18:28:23 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:24 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0a6cfa46-e4de-401c-a9e2-432f8ff905a4" returned: 0 in 0.303s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:24 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:28:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d56f50-77db-4301-9105-b7bb597b78a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6cfa46-e4de-401c-a9e2-432f8ff905a4', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22aa4937-bccb-4e5d-9246-093ad3950abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:24 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Volume volume-0a6cfa46-e4de-401c-a9e2-432f8ff905a4 (0a6cfa46-e4de-401c-a9e2-432f8ff905a4): created successfully Sep 10 18:28:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22aa4937-bccb-4e5d-9246-093ad3950abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Flow 'volume_create_manager' (86559c2a-0c88-4286-b780-6c13f46cf0fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:24 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ea574972-01c5-415b-bf1b-dbdc7dd44621 tempest-VolumesGetTest-1191421110 None] Created volume successfully. Sep 10 18:28:24 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:28:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Flow 'volume_create_manager' (f77b0f6b-f014-46d6-b3df-c769c8edfaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e45879-2ec5-4cbf-977d-9b1497a0fa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e45879-2ec5-4cbf-977d-9b1497a0fa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-344122350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c89976e-71c4-4974-90b8-39527adb3f4b,host='devstack@QuobyteHD#QuobyteHD',id=84f8fb35-32de-41b7-81b6-a5ba5b394afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187c586d1d8b431dbf607f5bc1892a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:25Z,use_quota=True,user_id='1efbe69d7fec41719c21c2f9972e6a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dd7ce8-eada-4ca7-a7b1-2892405f0f6a),volume_type_id=b2dd7ce8-eada-4ca7-a7b1-2892405f0f6a)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc3f250c-bed9-4c13-9f21-141b9b2e7172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc3f250c-bed9-4c13-9f21-141b9b2e7172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90dcacb4-784e-498a-970b-643a085ab33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90dcacb4-784e-498a-970b-643a085ab33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84f8fb35-32de-41b7-81b6-a5ba5b394afe', 'volume_name': 'volume-84f8fb35-32de-41b7-81b6-a5ba5b394afe', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd31435d-ec78-4268-977e-f3481fafcb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd31435d-ec78-4268-977e-f3481fafcb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df17be1a-1519-4c6b-bbb0-17ec6b8db63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:25 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Volume 84f8fb35-32de-41b7-81b6-a5ba5b394afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84f8fb35-32de-41b7-81b6-a5ba5b394afe', 'volume_size': 1} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c89976e-71c4-4974-90b8-39527adb3f4b,created_at=2026-09-10T16:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-344122350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c89976e-71c4-4974-90b8-39527adb3f4b,host='devstack@QuobyteHD#QuobyteHD',id=84f8fb35-32de-41b7-81b6-a5ba5b394afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187c586d1d8b431dbf607f5bc1892a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:25Z,use_quota=True,user_id='1efbe69d7fec41719c21c2f9972e6a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dd7ce8-eada-4ca7-a7b1-2892405f0f6a),volume_type_id=b2dd7ce8-eada-4ca7-a7b1-2892405f0f6a)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Creating volume 84f8fb35-32de-41b7-81b6-a5ba5b394afe {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:28:25 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-84f8fb35-32de-41b7-81b6-a5ba5b394afe 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:25 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-84f8fb35-32de-41b7-81b6-a5ba5b394afe 1073741824 Sep 10 18:28:25 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] Acquiring lock "cinder-0a6cfa46-e4de-401c-a9e2-432f8ff905a4-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] Lock "cinder-0a6cfa46-e4de-401c-a9e2-432f8ff905a4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] Acquiring lock "cinder-quobyte-0a6cfa46-e4de-401c-a9e2-432f8ff905a4" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] Lock "cinder-quobyte-0a6cfa46-e4de-401c-a9e2-432f8ff905a4" acquired by "delete_volume" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec5cda5-49d7-497d-bded-44cd05c27fa2]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0a6cfa46-e4de-401c-a9e2-432f8ff905a4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:25 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0a6cfa46-e4de-401c-a9e2-432f8ff905a4 Sep 10 18:28:25 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:25 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-84f8fb35-32de-41b7-81b6-a5ba5b394afe 1073741824" returned: 0 in 0.567s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-84f8fb35-32de-41b7-81b6-a5ba5b394afe {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:25 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-84f8fb35-32de-41b7-81b6-a5ba5b394afe Sep 10 18:28:25 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:25 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0a6cfa46-e4de-401c-a9e2-432f8ff905a4" returned: 0 in 0.472s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0a6cfa46-e4de-401c-a9e2-432f8ff905a4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:25 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-84f8fb35-32de-41b7-81b6-a5ba5b394afe" returned: 0 in 0.300s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:28:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:25 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0a6cfa46-e4de-401c-a9e2-432f8ff905a4 Sep 10 18:28:25 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df17be1a-1519-4c6b-bbb0-17ec6b8db63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f8fb35-32de-41b7-81b6-a5ba5b394afe', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40686556-ab49-4f8d-ab22-d7f86645db31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:26 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Volume volume-84f8fb35-32de-41b7-81b6-a5ba5b394afe (84f8fb35-32de-41b7-81b6-a5ba5b394afe): created successfully Sep 10 18:28:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40686556-ab49-4f8d-ab22-d7f86645db31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Flow 'volume_create_manager' (f77b0f6b-f014-46d6-b3df-c769c8edfaf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:26 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-62297c19-d352-4be6-967d-e322e659fb8d tempest-GroupsTest-77964215 None] Created volume successfully. Sep 10 18:28:26 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0a6cfa46-e4de-401c-a9e2-432f8ff905a4" returned: 0 in 0.421s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:26 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] Lock "cinder-quobyte-0a6cfa46-e4de-401c-a9e2-432f8ff905a4" released by "delete_volume" :: held 0.946s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:26 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-83e20fc4-9ce9-4a2a-8770-3085f623db27 tempest-GroupsTest-77964215 None] Update group completed successfully. Sep 10 18:28:26 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] Created reservations ['c9f78db5-f8ce-426d-8763-475d58e60498', '00e300fd-77ac-4bca-ae9f-be0ad833e246', 'b5b54b90-c642-47bd-a013-1ea9e95b852e', '1006881b-18f4-4982-8ada-9c6696014b53'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:26 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:26 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:26 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:26 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:26 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.316s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:26 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:26 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] Deleted volume successfully. Sep 10 18:28:26 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-96130769-f38a-4a8e-a7f7-d15972994c38 tempest-VolumesGetTest-1191421110 None] Lock "cinder-0a6cfa46-e4de-401c-a9e2-432f8ff905a4-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:27 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f428908f-7602-4748-ae81-6ae2ba96471c tempest-GroupsTest-77964215 None] Update group completed successfully. Sep 10 18:28:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] Acquiring lock "cinder-ce7d1bd6-96f0-4a18-b798-67e0196ada28-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] Lock "cinder-ce7d1bd6-96f0-4a18-b798-67e0196ada28-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] Acquiring lock "cinder-quobyte-ce7d1bd6-96f0-4a18-b798-67e0196ada28" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] Lock "cinder-quobyte-ce7d1bd6-96f0-4a18-b798-67e0196ada28" acquired by "delete_volume" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[daee9170-e6f7-4f3f-bcd2-78c784093090]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce7d1bd6-96f0-4a18-b798-67e0196ada28 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:28 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce7d1bd6-96f0-4a18-b798-67e0196ada28 Sep 10 18:28:28 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Flow 'volume_create_manager' (55a0a602-9672-4b0f-8ad9-cd0bdc5c04cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1607d07-9219-4135-8a0c-ea8998839dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1607d07-9219-4135-8a0c-ea8998839dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-274435622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcabb567-041d-4f43-bdb9-d01b4db0d8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfcabe2fe5747869712fa262838136c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:28Z,use_quota=True,user_id='0391af4d093f4e888f42e7c24e1be3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ddacf87-7030-463f-8a9d-eae8075856ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ddacf87-7030-463f-8a9d-eae8075856ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f80d596-cfe0-4327-884f-11d75f40319d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f80d596-cfe0-4327-884f-11d75f40319d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcabb567-041d-4f43-bdb9-d01b4db0d8d9', 'volume_name': 'volume-dcabb567-041d-4f43-bdb9-d01b4db0d8d9', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3681bc6-d324-44db-a2c1-0b1dfea65837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3681bc6-d324-44db-a2c1-0b1dfea65837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93f8e5c-ef71-41f0-ad12-87068b62d628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:28 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Volume dcabb567-041d-4f43-bdb9-d01b4db0d8d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcabb567-041d-4f43-bdb9-d01b4db0d8d9', 'volume_size': 1} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-274435622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcabb567-041d-4f43-bdb9-d01b4db0d8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfcabe2fe5747869712fa262838136c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:28Z,use_quota=True,user_id='0391af4d093f4e888f42e7c24e1be3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Creating volume dcabb567-041d-4f43-bdb9-d01b4db0d8d9 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:28:28 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dcabb567-041d-4f43-bdb9-d01b4db0d8d9 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:28 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dcabb567-041d-4f43-bdb9-d01b4db0d8d9 1073741824 Sep 10 18:28:28 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:28 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce7d1bd6-96f0-4a18-b798-67e0196ada28" returned: 0 in 0.389s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce7d1bd6-96f0-4a18-b798-67e0196ada28 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:28 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce7d1bd6-96f0-4a18-b798-67e0196ada28 Sep 10 18:28:28 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:28 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce7d1bd6-96f0-4a18-b798-67e0196ada28" returned: 0 in 0.291s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] Lock "cinder-quobyte-ce7d1bd6-96f0-4a18-b798-67e0196ada28" released by "delete_volume" :: held 0.761s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] Created reservations ['79997bc4-d6b6-41fa-bac6-8acd9ce78a1f', '9523612f-c376-43bc-93a1-8ccfbf967e7a', 'caf68be6-7cd9-458d-92dc-d19e64251ff5', '34d8ee27-c575-43e1-8938-8904269d5276'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:28 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dcabb567-041d-4f43-bdb9-d01b4db0d8d9 1073741824" returned: 0 in 0.656s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:29 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:29 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dcabb567-041d-4f43-bdb9-d01b4db0d8d9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:29 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:29 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:29 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dcabb567-041d-4f43-bdb9-d01b4db0d8d9 Sep 10 18:28:29 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:29 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dcabb567-041d-4f43-bdb9-d01b4db0d8d9" returned: 0 in 0.378s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93f8e5c-ef71-41f0-ad12-87068b62d628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcabb567-041d-4f43-bdb9-d01b4db0d8d9', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb328468-24eb-431d-be4c-eb6bb962d8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:29 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Volume volume-dcabb567-041d-4f43-bdb9-d01b4db0d8d9 (dcabb567-041d-4f43-bdb9-d01b4db0d8d9): created successfully Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb328468-24eb-431d-be4c-eb6bb962d8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Flow 'volume_create_manager' (55a0a602-9672-4b0f-8ad9-cd0bdc5c04cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:29 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-8c04c1c6-7e9c-4c69-a39d-8e413e1199f5 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Created volume successfully. Sep 10 18:28:29 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.667s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:29 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] Deleted volume successfully. Sep 10 18:28:29 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.625s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a6c46a04-768b-4a40-bbf1-6aa5cd696343 tempest-VolumesGetTest-1191421110 None] Lock "cinder-ce7d1bd6-96f0-4a18-b798-67e0196ada28-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 28 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:28:29 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Flow 'volume_create_manager' (cc6f6d25-d0af-44e0-bf9a-2fefa70d7241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2582b2-1327-4ada-9571-1043e730b533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2582b2-1327-4ada-9571-1043e730b533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-505325754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a43590-39c5-453d-8b67-97aba036089d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20964ae34a24e53a761285adfa44fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:30Z,use_quota=True,user_id='b52c4aee3e464577882f22cf85158e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68350753-36a9-4a35-af72-3254f941e0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68350753-36a9-4a35-af72-3254f941e0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9749a2df-cd63-4179-a9a6-d14773653168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9749a2df-cd63-4179-a9a6-d14773653168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0a43590-39c5-453d-8b67-97aba036089d', 'volume_name': 'volume-e0a43590-39c5-453d-8b67-97aba036089d', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43660fe4-1ad8-4f22-a34b-b0ee8e71959e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43660fe4-1ad8-4f22-a34b-b0ee8e71959e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (014c871e-e992-4d0f-996e-c914b080abf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:30 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Volume e0a43590-39c5-453d-8b67-97aba036089d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0a43590-39c5-453d-8b67-97aba036089d', 'volume_size': 1} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-505325754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a43590-39c5-453d-8b67-97aba036089d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20964ae34a24e53a761285adfa44fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:30Z,use_quota=True,user_id='b52c4aee3e464577882f22cf85158e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Creating volume e0a43590-39c5-453d-8b67-97aba036089d {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:28:30 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:30 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d 1073741824 Sep 10 18:28:30 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Acquiring lock "cinder-quobyte-16b804f2-0647-448d-918d-52a65a1ec11e" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Lock "cinder-quobyte-16b804f2-0647-448d-918d-52a65a1ec11e" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34140df-8134-468d-9b2a-dcfd016e1bce]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16b804f2-0647-448d-918d-52a65a1ec11e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:30 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16b804f2-0647-448d-918d-52a65a1ec11e Sep 10 18:28:30 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:30 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d 1073741824" returned: 0 in 0.539s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:30 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16b804f2-0647-448d-918d-52a65a1ec11e" returned: 0 in 0.461s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16b804f2-0647-448d-918d-52a65a1ec11e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:30 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16b804f2-0647-448d-918d-52a65a1ec11e Sep 10 18:28:30 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:30 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d Sep 10 18:28:30 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Acquiring lock "cinder-dcabb567-041d-4f43-bdb9-d01b4db0d8d9-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Lock "cinder-dcabb567-041d-4f43-bdb9-d01b4db0d8d9-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=179,cinder:INSERT=59,cinder:UPDATE=244,cinder:DELETE=14 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:28:30 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=201,cinder:INSERT=48,cinder:UPDATE=209,cinder:DELETE=19 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:28:31 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-16b804f2-0647-448d-918d-52a65a1ec11e" returned: 0 in 0.336s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Acquiring lock "cinder-quobyte-dcabb567-041d-4f43-bdb9-d01b4db0d8d9" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Lock "cinder-quobyte-dcabb567-041d-4f43-bdb9-d01b4db0d8d9" acquired by "delete_volume" :: waited 0.028s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Lock "cinder-quobyte-16b804f2-0647-448d-918d-52a65a1ec11e" released by "delete_volume" :: held 0.879s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Acquiring lock "cinder-quobyte-84f8fb35-32de-41b7-81b6-a5ba5b394afe" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccef369-ecfe-4bc7-b9dd-c2e3dfeb48fc]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dcabb567-041d-4f43-bdb9-d01b4db0d8d9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Lock "cinder-quobyte-84f8fb35-32de-41b7-81b6-a5ba5b394afe" acquired by "delete_volume" :: waited 0.030s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:31 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d" returned: 0 in 0.414s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e94f88-661e-4d2a-9fa1-c31105e6581e]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-84f8fb35-32de-41b7-81b6-a5ba5b394afe {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (014c871e-e992-4d0f-996e-c914b080abf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a43590-39c5-453d-8b67-97aba036089d', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40f3b25-ead1-4bce-aaee-d7c772fddb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:31 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Volume volume-e0a43590-39c5-453d-8b67-97aba036089d (e0a43590-39c5-453d-8b67-97aba036089d): created successfully Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40f3b25-ead1-4bce-aaee-d7c772fddb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Flow 'volume_create_manager' (cc6f6d25-d0af-44e0-bf9a-2fefa70d7241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:31 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-7284a064-6a8f-4a60-b31d-606d6ad42d0d tempest-VolumesGetTest-1191421110 None] Created volume successfully. Sep 10 18:28:31 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dcabb567-041d-4f43-bdb9-d01b4db0d8d9 Sep 10 18:28:31 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:31 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-84f8fb35-32de-41b7-81b6-a5ba5b394afe Sep 10 18:28:31 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:31 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dcabb567-041d-4f43-bdb9-d01b4db0d8d9" returned: 0 in 0.490s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dcabb567-041d-4f43-bdb9-d01b4db0d8d9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:31 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-84f8fb35-32de-41b7-81b6-a5ba5b394afe" returned: 0 in 0.461s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-84f8fb35-32de-41b7-81b6-a5ba5b394afe {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:31 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dcabb567-041d-4f43-bdb9-d01b4db0d8d9 Sep 10 18:28:31 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:31 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-84f8fb35-32de-41b7-81b6-a5ba5b394afe Sep 10 18:28:31 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:31 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dcabb567-041d-4f43-bdb9-d01b4db0d8d9" returned: 0 in 0.293s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Lock "cinder-quobyte-dcabb567-041d-4f43-bdb9-d01b4db0d8d9" released by "delete_volume" :: held 0.838s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:31 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-84f8fb35-32de-41b7-81b6-a5ba5b394afe" returned: 0 in 0.304s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Lock "cinder-quobyte-84f8fb35-32de-41b7-81b6-a5ba5b394afe" released by "delete_volume" :: held 0.824s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Created reservations ['1041861e-1e88-46b4-babb-b69dbbb5138d', '06378ade-b3b6-4ee2-813a-8efd456517b6', '06bfbb88-a010-49ce-8662-5d0832dc0fed', 'ae4db37a-e439-4cf0-a55b-534873769074'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Created reservations ['372b497a-0ef6-49ea-9d39-fd3a733bf40f'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:32 devstack cinder-volume[87842]: WARNING cinder.quota [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-99658964 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-99658964, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:28:32 devstack cinder-volume[87842]: WARNING cinder.quota [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-99658964 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-99658964, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:28:32 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:32 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Created reservations ['7cef75df-f34e-421a-969a-ec5109b3e883', 'cc0eb98e-a8f9-4d84-85da-91a3eb793dd9', 'b53d1e2b-b3a2-4ab7-92f1-b577cad1b2de', '0c607ae3-9100-4b5e-80bf-78780e17fed6'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Created reservations ['f3fd5d61-57c6-469d-8831-a2519d605e3d', '587f5b89-e1aa-4259-845b-c1f83a3cf22b', '42f378dc-9854-469f-861b-944b9b029e4f', 'bed7a109-b922-4fdc-a29f-47b821a1af0a'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:32 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:32 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:32 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.411s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:32 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Deleted volume successfully. Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c8cdbfcd-a9ac-4cbd-ba76-7afe75f45549 tempest-VolumeQuotasAdminTestJSON-1052064243 None] Lock "cinder-dcabb567-041d-4f43-bdb9-d01b4db0d8d9-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:32 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.432s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:32 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-66d8a79a-8274-424e-8408-d61fadd761c5 tempest-GroupsTest-77964215 None] Delete group completed successfully. Sep 10 18:28:32 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Flow 'volume_create_manager' (0fcd893f-6d64-41d3-b48f-f37a9e95ed2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4dd795e-58d5-4dde-82e8-fc900baa742f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4dd795e-58d5-4dde-82e8-fc900baa742f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1512696978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d8c8bb-1002-4064-84cc-2c6ad99be6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfcabe2fe5747869712fa262838136c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:33Z,use_quota=True,user_id='0391af4d093f4e888f42e7c24e1be3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c633077-b2f3-4cbe-bda0-7a93ba925a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c633077-b2f3-4cbe-bda0-7a93ba925a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45719daf-8079-4c39-9d76-bdaccba50a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45719daf-8079-4c39-9d76-bdaccba50a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d8c8bb-1002-4064-84cc-2c6ad99be6d9', 'volume_name': 'volume-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2ce2b5b-c7a9-46ab-a094-a769a8cc60d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2ce2b5b-c7a9-46ab-a094-a769a8cc60d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd334a9-b716-4190-a3e2-0aa3f8ba9170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:33 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Volume b9d8c8bb-1002-4064-84cc-2c6ad99be6d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9', 'volume_size': 1} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1512696978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d8c8bb-1002-4064-84cc-2c6ad99be6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfcabe2fe5747869712fa262838136c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:33Z,use_quota=True,user_id='0391af4d093f4e888f42e7c24e1be3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Creating volume b9d8c8bb-1002-4064-84cc-2c6ad99be6d9 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:28:33 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:33 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9 1073741824 Sep 10 18:28:33 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Flow 'volume_create_manager' (b93196c1-53e1-4eef-ae42-6da02dc246c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d30687-c9ff-4f97-b557-ad6340c0546e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d30687-c9ff-4f97-b557-ad6340c0546e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2083042364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26b53a4a-f78b-4e8e-9e02-ac0d29e0f370,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e20964ae34a24e53a761285adfa44fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e0a43590-39c5-453d-8b67-97aba036089d,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:33Z,use_quota=True,user_id='b52c4aee3e464577882f22cf85158e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ae2d94-6e74-492f-ba2f-2ff5adc56ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ae2d94-6e74-492f-ba2f-2ff5adc56ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4152b6c8-4dee-4405-8228-a1c1d41b2cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4152b6c8-4dee-4405-8228-a1c1d41b2cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '26b53a4a-f78b-4e8e-9e02-ac0d29e0f370', 'volume_name': 'volume-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370', 'volume_size': 1, 'source_volid': 'e0a43590-39c5-453d-8b67-97aba036089d', 'source_volstatus': 'available'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd9d7c4-1a79-492b-9c59-695832e83078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd9d7c4-1a79-492b-9c59-695832e83078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2757483b-bfbd-43c0-97db-980d4e7b2f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:33 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Volume 26b53a4a-f78b-4e8e-9e02-ac0d29e0f370: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370', 'volume_size': 1, 'source_volid': 'e0a43590-39c5-453d-8b67-97aba036089d', 'source_volstatus': 'available'} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:33 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9 1073741824" returned: 0 in 0.532s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:33 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9 Sep 10 18:28:33 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:33 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9" returned: 0 in 0.315s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.673s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:33 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Cloning volume e0a43590-39c5-453d-8b67-97aba036089d to volume 26b53a4a-f78b-4e8e-9e02-ac0d29e0f370 Sep 10 18:28:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd334a9-b716-4190-a3e2-0aa3f8ba9170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9dd5c1-1c80-45f5-b545-c8b861647a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:34 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Volume volume-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9 (b9d8c8bb-1002-4064-84cc-2c6ad99be6d9): created successfully Sep 10 18:28:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9dd5c1-1c80-45f5-b545-c8b861647a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Flow 'volume_create_manager' (0fcd893f-6d64-41d3-b48f-f37a9e95ed2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Creating offline snapshot 5d96aef4-80f3-434c-a008-521a12aa1446 of volume e0a43590-39c5-453d-8b67-97aba036089d {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:28:34 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-bb21477d-8d32-4f14-b30a-f82e011ef15d tempest-VolumeQuotasAdminTestJSON-1052064243 None] Created volume successfully. Sep 10 18:28:34 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba893da-f670-4352-8183-8c5b2dff6e9c]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:34 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d Sep 10 18:28:34 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:34 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d" returned: 0 in 0.393s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:34 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446 1G Sep 10 18:28:34 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:35 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446 1G" returned: 0 in 0.591s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0a43590-39c5-453d-8b67-97aba036089d -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:35 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0a43590-39c5-453d-8b67-97aba036089d -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446 Sep 10 18:28:35 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:35 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0a43590-39c5-453d-8b67-97aba036089d -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446" returned: 0 in 0.495s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:35 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446 is being set with open permissions: ugo+rw Sep 10 18:28:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:35 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446 Sep 10 18:28:35 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:35 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446" returned: 0 in 0.374s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:36 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.info Sep 10 18:28:36 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:36 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-652b972f-7402-497f-b5f8-db231110f357 tempest-VolumeQuotasAdminTestJSON-36307174 None] Transfer volume completed successfully. Sep 10 18:28:36 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.info" returned: 0 in 0.432s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:36 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.info is being set with open permissions: ugo+rw Sep 10 18:28:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:36 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.info Sep 10 18:28:36 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:36 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.info" returned: 0 in 0.334s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Acquiring lock "cinder-quobyte-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370" by "_copy_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Lock "cinder-quobyte-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] snapshot: 5d96aef4-80f3-434c-a008-521a12aa1446, volume: 26b53a4a-f78b-4e8e-9e02-ac0d29e0f370, {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 18:28:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:36 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[af71525a-808b-49f9-95d7-a1fe0dd89e67]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] Acquiring lock "cinder-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] Lock "cinder-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:37 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] Acquiring lock "cinder-quobyte-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:37 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] Lock "cinder-quobyte-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9" acquired by "delete_volume" :: waited 0.014s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:37 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3203d9-ad36-4f77-8ca0-27d65c6b9d83]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:37 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446 Sep 10 18:28:37 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:37 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9 Sep 10 18:28:37 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:37 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446" returned: 0 in 0.618s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0a43590-39c5-453d-8b67-97aba036089d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:28:37 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58dd106-8aa0-4520-82e2-ffdeb2277eca]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:37 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9" returned: 0 in 0.551s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:37 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9 Sep 10 18:28:37 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:37 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d Sep 10 18:28:37 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:37 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9" returned: 0 in 0.362s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:37 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d" returned: 0 in 0.476s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 18:28:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Creating direct copy from snapshot {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 18:28:38 devstack cinder-volume[87842]: DEBUG cinder.utils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Path /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370 not found in is_blk_device check {{(pid=87842) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 18:28:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] Lock "cinder-quobyte-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9" released by "delete_volume" :: held 0.998s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:38 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370 Sep 10 18:28:38 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:38 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] Created reservations ['8ebc094d-65a1-42ab-99cd-8eaf004abcc2', '6cc624b4-ccfc-4c38-9b98-1db56125ffa2', '947e787f-df0c-4ab4-95e9-79affbd33492', 'dd468a85-3318-499f-89cf-f74623140eaf'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:38 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:38 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:38 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.279s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:38 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:38 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] Deleted volume successfully. Sep 10 18:28:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7437cfba-c3b2-44da-8edc-952fe5ef18a3 tempest-VolumeQuotasAdminTestJSON-2051254264 None] Lock "cinder-b9d8c8bb-1002-4064-84cc-2c6ad99be6d9-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:43 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:28:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Flow 'volume_create_manager' (022e25b7-0750-4d6a-826c-448650ad2843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b62e20-afc0-48d4-999a-598988fbc83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b62e20-afc0-48d4-999a-598988fbc83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-705772582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f81377-0e4e-4d7e-9306-9ccd398af17b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ceeafbe4bf4e9ab5ce0a6337e21cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:44Z,use_quota=True,user_id='8c892c9d21ee4262ac5a3d1abd6f9652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b324728-b34b-4941-a6dc-c70c12bc9474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b324728-b34b-4941-a6dc-c70c12bc9474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c11d259-eda8-420f-aeb7-0b2c7621f7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c11d259-eda8-420f-aeb7-0b2c7621f7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0f81377-0e4e-4d7e-9306-9ccd398af17b', 'volume_name': 'volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d096cd4b-ff20-42c6-b61a-ea5723f8cb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d096cd4b-ff20-42c6-b61a-ea5723f8cb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffe080a-cc17-4eab-a2e9-dbedf291d57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:43 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Volume d0f81377-0e4e-4d7e-9306-9ccd398af17b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b', 'volume_size': 1} Sep 10 18:28:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:44 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370" returned: 0 in 6.021s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:44 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Image conversion details: src /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370 {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:28:44 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Converted 1024.00 MB image at 170.02 MB/s Sep 10 18:28:44 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370 is being set with open permissions: ugo+rw Sep 10 18:28:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:44 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370 Sep 10 18:28:44 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:44 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370" returned: 0 in 0.299s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:44 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Lock "cinder-quobyte-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370" released by "_copy_volume_from_snapshot" :: held 7.529s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:44 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Acquiring lock "cinder-quobyte-5d96aef4-80f3-434c-a008-521a12aa1446" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:44 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Lock "cinder-quobyte-5d96aef4-80f3-434c-a008-521a12aa1446" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Deleting offline snapshot 5d96aef4-80f3-434c-a008-521a12aa1446 of volume e0a43590-39c5-453d-8b67-97aba036089d {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:28:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] snapshot_file for this snap is: volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:28:44 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82d857a-698b-4d24-8541-39d9584a7c45]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:44 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446 Sep 10 18:28:44 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:44 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446" returned: 0 in 0.429s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0a43590-39c5-453d-8b67-97aba036089d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:28:44 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d083d34-8445-4cb4-ac3f-3e505d05f33b]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:45 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d Sep 10 18:28:45 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:45 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d" returned: 0 in 0.582s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:45 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446 Sep 10 18:28:45 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:45 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446" returned: 0 in 0.398s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:45 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446 Sep 10 18:28:45 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:46 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d.5d96aef4-80f3-434c-a008-521a12aa1446" returned: 0 in 0.257s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:46 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Lock "cinder-quobyte-5d96aef4-80f3-434c-a008-521a12aa1446" released by "_delete_snapshot" :: held 1.802s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.240s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.263s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-705772582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f81377-0e4e-4d7e-9306-9ccd398af17b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ceeafbe4bf4e9ab5ce0a6337e21cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:44Z,use_quota=True,user_id='8c892c9d21ee4262ac5a3d1abd6f9652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:28:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Creating volume d0f81377-0e4e-4d7e-9306-9ccd398af17b {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:28:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:28:46 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:28:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2757483b-bfbd-43c0-97db-980d4e7b2f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370', 'volume_size': 1, 'source_volid': 'e0a43590-39c5-453d-8b67-97aba036089d', 'source_volstatus': 'available'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:46 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b 1073741824 Sep 10 18:28:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bcacf84-0d7a-4d3e-9d60-399aed2de919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:46 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:46 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Volume volume-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370 (26b53a4a-f78b-4e8e-9e02-ac0d29e0f370): created successfully Sep 10 18:28:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bcacf84-0d7a-4d3e-9d60-399aed2de919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Flow 'volume_create_manager' (b93196c1-53e1-4eef-ae42-6da02dc246c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:46 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-5fba0a79-f320-45c2-bb5a-2e85148ed972 tempest-VolumesGetTest-1191421110 None] Created volume successfully. Sep 10 18:28:46 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b 1073741824" returned: 0 in 0.618s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:46 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b Sep 10 18:28:46 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:47 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b" returned: 0 in 0.409s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffe080a-cc17-4eab-a2e9-dbedf291d57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3020944b-e5b4-47be-a6a1-562f657d77c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:47 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Volume volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b (d0f81377-0e4e-4d7e-9306-9ccd398af17b): created successfully Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3020944b-e5b4-47be-a6a1-562f657d77c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Flow 'volume_create_manager' (022e25b7-0750-4d6a-826c-448650ad2843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:47 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-aa1813ea-0865-4a00-9b34-9e4537b94b68 tempest-SnapshotsActionsTest-713773610 None] Created volume successfully. Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Flow 'volume_create_manager' (2bea5917-7f47-41bb-b04a-a01c72bfd36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abad6e4b-c91a-4058-9c63-b10a6f74e929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abad6e4b-c91a-4058-9c63-b10a6f74e929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1852606795',display_name='tempest-VolumesGetTest-Volume-1258265777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31846cfb-3292-4f89-bbcb-ed37a3967e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20964ae34a24e53a761285adfa44fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:47Z,use_quota=True,user_id='b52c4aee3e464577882f22cf85158e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d8dc83-860b-466c-a404-c8f963a2ab96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d8dc83-860b-466c-a404-c8f963a2ab96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1f50c0-c0d8-45a1-940c-ee64b5873c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1f50c0-c0d8-45a1-940c-ee64b5873c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31846cfb-3292-4f89-bbcb-ed37a3967e51', 'volume_name': 'volume-31846cfb-3292-4f89-bbcb-ed37a3967e51', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9e8ef3-0463-4825-9017-dee6a7af2ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9e8ef3-0463-4825-9017-dee6a7af2ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9604663d-5ce3-486a-81a4-82f9f69353c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:47 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Volume 31846cfb-3292-4f89-bbcb-ed37a3967e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31846cfb-3292-4f89-bbcb-ed37a3967e51', 'volume_size': 1} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1852606795',display_name='tempest-VolumesGetTest-Volume-1258265777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31846cfb-3292-4f89-bbcb-ed37a3967e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20964ae34a24e53a761285adfa44fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:47Z,use_quota=True,user_id='b52c4aee3e464577882f22cf85158e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Creating volume 31846cfb-3292-4f89-bbcb-ed37a3967e51 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:28:47 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:28:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31846cfb-3292-4f89-bbcb-ed37a3967e51 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:47 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31846cfb-3292-4f89-bbcb-ed37a3967e51 1073741824 Sep 10 18:28:47 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:48 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31846cfb-3292-4f89-bbcb-ed37a3967e51 1073741824" returned: 0 in 0.577s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31846cfb-3292-4f89-bbcb-ed37a3967e51 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:48 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31846cfb-3292-4f89-bbcb-ed37a3967e51 Sep 10 18:28:48 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-562a305b-c13a-4d7a-b913-cafb7baeb590 tempest-SnapshotsActionsTest-713773610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:48 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31846cfb-3292-4f89-bbcb-ed37a3967e51" returned: 0 in 0.340s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:28:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-562a305b-c13a-4d7a-b913-cafb7baeb590 tempest-SnapshotsActionsTest-713773610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.236s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9604663d-5ce3-486a-81a4-82f9f69353c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31846cfb-3292-4f89-bbcb-ed37a3967e51', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd91193-48b7-48c5-a470-c04381804052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-562a305b-c13a-4d7a-b913-cafb7baeb590 tempest-SnapshotsActionsTest-713773610 None] Creating offline snapshot 8b52a649-7eec-4f2a-aca7-b3523b0336ca of volume d0f81377-0e4e-4d7e-9306-9ccd398af17b {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:28:48 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Volume volume-31846cfb-3292-4f89-bbcb-ed37a3967e51 (31846cfb-3292-4f89-bbcb-ed37a3967e51): created successfully Sep 10 18:28:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd91193-48b7-48c5-a470-c04381804052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Flow 'volume_create_manager' (2bea5917-7f47-41bb-b04a-a01c72bfd36d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:48 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23ea029-2fd1-4bc8-8444-c771dbf0ae2b]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-562a305b-c13a-4d7a-b913-cafb7baeb590 tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:48 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-1527ae7c-1298-40e3-8818-fe6ba8716ec6 tempest-VolumesGetTest-1191421110 None] Created volume successfully. Sep 10 18:28:48 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b Sep 10 18:28:48 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:49 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-562a305b-c13a-4d7a-b913-cafb7baeb590 tempest-SnapshotsActionsTest-713773610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b" returned: 0 in 0.447s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-562a305b-c13a-4d7a-b913-cafb7baeb590 tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:49 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca 1G Sep 10 18:28:49 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:49 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-562a305b-c13a-4d7a-b913-cafb7baeb590 tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca 1G" returned: 0 in 0.481s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-562a305b-c13a-4d7a-b913-cafb7baeb590 tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:49 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca Sep 10 18:28:49 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] Acquiring lock "cinder-31846cfb-3292-4f89-bbcb-ed37a3967e51-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] Lock "cinder-31846cfb-3292-4f89-bbcb-ed37a3967e51-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] Acquiring lock "cinder-quobyte-31846cfb-3292-4f89-bbcb-ed37a3967e51" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] Lock "cinder-quobyte-31846cfb-3292-4f89-bbcb-ed37a3967e51" acquired by "delete_volume" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:49 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adaef18-3b37-4d6a-807a-1b61fd369ea8]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31846cfb-3292-4f89-bbcb-ed37a3967e51 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:50 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-562a305b-c13a-4d7a-b913-cafb7baeb590 tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca" returned: 0 in 0.406s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:50 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-562a305b-c13a-4d7a-b913-cafb7baeb590 tempest-SnapshotsActionsTest-713773610 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca is being set with open permissions: ugo+rw Sep 10 18:28:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-562a305b-c13a-4d7a-b913-cafb7baeb590 tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:50 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca Sep 10 18:28:50 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:50 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31846cfb-3292-4f89-bbcb-ed37a3967e51 Sep 10 18:28:50 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:50 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-562a305b-c13a-4d7a-b913-cafb7baeb590 tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca" returned: 0 in 0.279s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-562a305b-c13a-4d7a-b913-cafb7baeb590 tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:50 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.info Sep 10 18:28:50 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:50 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31846cfb-3292-4f89-bbcb-ed37a3967e51" returned: 0 in 0.501s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31846cfb-3292-4f89-bbcb-ed37a3967e51 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:50 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31846cfb-3292-4f89-bbcb-ed37a3967e51 Sep 10 18:28:50 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:50 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-562a305b-c13a-4d7a-b913-cafb7baeb590 tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.info" returned: 0 in 0.346s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:50 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-562a305b-c13a-4d7a-b913-cafb7baeb590 tempest-SnapshotsActionsTest-713773610 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.info is being set with open permissions: ugo+rw Sep 10 18:28:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-562a305b-c13a-4d7a-b913-cafb7baeb590 tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:50 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.info Sep 10 18:28:50 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:50 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31846cfb-3292-4f89-bbcb-ed37a3967e51" returned: 0 in 0.276s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] Lock "cinder-quobyte-31846cfb-3292-4f89-bbcb-ed37a3967e51" released by "delete_volume" :: held 0.846s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:50 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] Created reservations ['7f82d3d0-530a-468f-aaa9-33c24cfd87d9', 'a1e3523d-2aae-4211-9524-c7483c0fa6ce', '626a7e9e-ef4a-4f43-be94-cd70ff089224', '26a7072b-4fe2-4787-9484-27be0f035a60'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:50 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:50 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:51 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-562a305b-c13a-4d7a-b913-cafb7baeb590 tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.info" returned: 0 in 0.408s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-562a305b-c13a-4d7a-b913-cafb7baeb590 tempest-SnapshotsActionsTest-713773610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.547s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:51 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-562a305b-c13a-4d7a-b913-cafb7baeb590 tempest-SnapshotsActionsTest-713773610 None] Create snapshot completed successfully Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] Acquiring lock "cinder-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] Lock "cinder-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] Acquiring lock "cinder-quobyte-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:51 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] Lock "cinder-quobyte-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370" acquired by "delete_volume" :: waited 0.030s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.417s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:51 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] Deleted volume successfully. Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca39ea5f-c212-478d-a650-c4c8f47c73db]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d472ba76-a343-4fda-bf59-f28c3249277e tempest-VolumesGetTest-1191421110 None] Lock "cinder-31846cfb-3292-4f89-bbcb-ed37a3967e51-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:51 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370 Sep 10 18:28:51 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Flow 'volume_create_manager' (2ada9601-7e93-4454-b6f0-abf9a4e797ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0150c112-5c96-4d5c-b917-6c9e865f972c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0150c112-5c96-4d5c-b917-6c9e865f972c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-170809380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b38e38-e5b5-4b90-8dab-15a0b5609322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7535726dfab54cf295cfcc8035152697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:52Z,use_quota=True,user_id='d5e12cccf944481f9a3c09b588e0c7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(144a0a5f-8c48-447c-921f-74f9be4c85b5),volume_type_id=144a0a5f-8c48-447c-921f-74f9be4c85b5)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498ed3bb-32c1-4f69-92ce-13fccd1f5cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498ed3bb-32c1-4f69-92ce-13fccd1f5cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a35b784-d6bc-4aa2-b1c7-aa95a413660a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a35b784-d6bc-4aa2-b1c7-aa95a413660a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9b38e38-e5b5-4b90-8dab-15a0b5609322', 'volume_name': 'volume-a9b38e38-e5b5-4b90-8dab-15a0b5609322', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc11eab-3e44-4845-8895-d7637dec1554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc11eab-3e44-4845-8895-d7637dec1554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a300fc01-4a41-42d6-b754-4233337c812e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:51 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Volume a9b38e38-e5b5-4b90-8dab-15a0b5609322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9b38e38-e5b5-4b90-8dab-15a0b5609322', 'volume_size': 1} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-170809380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b38e38-e5b5-4b90-8dab-15a0b5609322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7535726dfab54cf295cfcc8035152697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:52Z,use_quota=True,user_id='d5e12cccf944481f9a3c09b588e0c7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(144a0a5f-8c48-447c-921f-74f9be4c85b5),volume_type_id=144a0a5f-8c48-447c-921f-74f9be4c85b5)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Creating volume a9b38e38-e5b5-4b90-8dab-15a0b5609322 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:28:51 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9b38e38-e5b5-4b90-8dab-15a0b5609322 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:51 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9b38e38-e5b5-4b90-8dab-15a0b5609322 1073741824 Sep 10 18:28:51 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:51 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370" returned: 0 in 0.582s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:51 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370 Sep 10 18:28:51 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:52 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370" returned: 0 in 0.330s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] Lock "cinder-quobyte-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370" released by "delete_volume" :: held 0.984s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:52 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9b38e38-e5b5-4b90-8dab-15a0b5609322 1073741824" returned: 0 in 0.547s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1da60974-8a08-4bb6-b0ba-90026daf48dd tempest-SnapshotsActionsTest-713773610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9b38e38-e5b5-4b90-8dab-15a0b5609322 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] Created reservations ['5ca82903-4b61-4f38-a1fc-45a3b315dbcd', '850d9c25-5253-4422-b388-dd1b96ffd25f', '72373520-9416-408e-be03-cb7dc0a2da09', '3808c151-feac-4211-bfee-34433eeb65a9'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:52 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9b38e38-e5b5-4b90-8dab-15a0b5609322 Sep 10 18:28:52 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:52 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:52 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:52 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9b38e38-e5b5-4b90-8dab-15a0b5609322" returned: 0 in 0.293s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1da60974-8a08-4bb6-b0ba-90026daf48dd tempest-SnapshotsActionsTest-713773610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.333s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-1da60974-8a08-4bb6-b0ba-90026daf48dd tempest-SnapshotsActionsTest-713773610 None] Creating offline snapshot 00b58c26-12b9-4c28-b285-a0cbdad52a13 of volume d0f81377-0e4e-4d7e-9306-9ccd398af17b {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a300fc01-4a41-42d6-b754-4233337c812e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9b38e38-e5b5-4b90-8dab-15a0b5609322', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ac6531-677e-45ab-802c-c5551057588c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c761a7-dee5-41ce-8929-2d3f5f1c5d6e]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1da60974-8a08-4bb6-b0ba-90026daf48dd tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:52 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.308s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:52 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Volume volume-a9b38e38-e5b5-4b90-8dab-15a0b5609322 (a9b38e38-e5b5-4b90-8dab-15a0b5609322): created successfully Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ac6531-677e-45ab-802c-c5551057588c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Flow 'volume_create_manager' (2ada9601-7e93-4454-b6f0-abf9a4e797ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:52 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] Deleted volume successfully. Sep 10 18:28:52 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-33257445-4b86-4bc3-8e3d-2c58fd6a0073 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Created volume successfully. Sep 10 18:28:52 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-71297217-a8d8-45c9-a29d-43ecf3f98a62 tempest-VolumesGetTest-1191421110 None] Lock "cinder-26b53a4a-f78b-4e8e-9e02-ac0d29e0f370-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:52 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca Sep 10 18:28:52 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:53 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1da60974-8a08-4bb6-b0ba-90026daf48dd tempest-SnapshotsActionsTest-713773610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca" returned: 0 in 0.392s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-1da60974-8a08-4bb6-b0ba-90026daf48dd tempest-SnapshotsActionsTest-713773610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:28:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1da60974-8a08-4bb6-b0ba-90026daf48dd tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:53 devstack sudo[99110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13 1G Sep 10 18:28:53 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] Acquiring lock "cinder-e0a43590-39c5-453d-8b67-97aba036089d-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] Lock "cinder-e0a43590-39c5-453d-8b67-97aba036089d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] Acquiring lock "cinder-quobyte-e0a43590-39c5-453d-8b67-97aba036089d" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] Lock "cinder-quobyte-e0a43590-39c5-453d-8b67-97aba036089d" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:53 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f60450a-9c8e-48d5-ae3c-d2938ef3ead4]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:53 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1da60974-8a08-4bb6-b0ba-90026daf48dd tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13 1G" returned: 0 in 0.608s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1da60974-8a08-4bb6-b0ba-90026daf48dd tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:53 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13 Sep 10 18:28:53 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:53 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d Sep 10 18:28:53 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:54 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d" returned: 0 in 0.633s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:54 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d Sep 10 18:28:54 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:54 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1da60974-8a08-4bb6-b0ba-90026daf48dd tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13" returned: 0 in 0.634s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:54 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-1da60974-8a08-4bb6-b0ba-90026daf48dd tempest-SnapshotsActionsTest-713773610 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13 is being set with open permissions: ugo+rw Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1da60974-8a08-4bb6-b0ba-90026daf48dd tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-229a9712-9107-4b7e-841e-6e7bdc4c9d7f tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-229a9712-9107-4b7e-841e-6e7bdc4c9d7f tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-229a9712-9107-4b7e-841e-6e7bdc4c9d7f tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-229a9712-9107-4b7e-841e-6e7bdc4c9d7f tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-229a9712-9107-4b7e-841e-6e7bdc4c9d7f tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-229a9712-9107-4b7e-841e-6e7bdc4c9d7f tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:54 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13 Sep 10 18:28:54 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:54 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:54 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:54 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0a43590-39c5-453d-8b67-97aba036089d" returned: 0 in 0.328s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] Lock "cinder-quobyte-e0a43590-39c5-453d-8b67-97aba036089d" released by "delete_volume" :: held 1.058s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:54 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1da60974-8a08-4bb6-b0ba-90026daf48dd tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13" returned: 0 in 0.320s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1da60974-8a08-4bb6-b0ba-90026daf48dd tempest-SnapshotsActionsTest-713773610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.136s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] Created reservations ['ad15aa9e-93fb-444e-a504-82bec7cb4dcf', '1d7ebaf0-d99d-4c4c-8095-e14a08704647', '558d9f40-94a9-4811-8ea7-c34c0da6c0f5', 'dc204b99-1a11-4f5c-a033-9e92814584dd'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:54 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-1da60974-8a08-4bb6-b0ba-90026daf48dd tempest-SnapshotsActionsTest-713773610 None] Create snapshot completed successfully Sep 10 18:28:54 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-229a9712-9107-4b7e-841e-6e7bdc4c9d7f tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.457s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-229a9712-9107-4b7e-841e-6e7bdc4c9d7f tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:54 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-229a9712-9107-4b7e-841e-6e7bdc4c9d7f tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Retype volume completed successfully. Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:55 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:55 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:55 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.252s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:55 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:55 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] Deleted volume successfully. Sep 10 18:28:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-74423549-b46c-4a81-96e8-9baa3d5ee5d2 tempest-VolumesGetTest-1191421110 None] Lock "cinder-e0a43590-39c5-453d-8b67-97aba036089d-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] Acquiring lock "cinder-00b58c26-12b9-4c28-b285-a0cbdad52a13-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-00b58c26-12b9-4c28-b285-a0cbdad52a13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] Acquiring lock "cinder-quobyte-d0f81377-0e4e-4d7e-9306-9ccd398af17b" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Acquiring lock "cinder-a9b38e38-e5b5-4b90-8dab-15a0b5609322-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-quobyte-d0f81377-0e4e-4d7e-9306-9ccd398af17b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] Acquiring lock "cinder-quobyte-00b58c26-12b9-4c28-b285-a0cbdad52a13" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Lock "cinder-a9b38e38-e5b5-4b90-8dab-15a0b5609322-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-quobyte-00b58c26-12b9-4c28-b285-a0cbdad52a13" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:55 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] Deleting offline snapshot 00b58c26-12b9-4c28-b285-a0cbdad52a13 of volume d0f81377-0e4e-4d7e-9306-9ccd398af17b {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:28:55 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] snapshot_file for this snap is: volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:28:55 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[66602c85-79a1-4fd1-b67f-9154854ccc5e]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Acquiring lock "cinder-quobyte-a9b38e38-e5b5-4b90-8dab-15a0b5609322" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:28:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Lock "cinder-quobyte-a9b38e38-e5b5-4b90-8dab-15a0b5609322" acquired by "delete_volume" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:28:55 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[443f9b2e-321e-46db-bbac-c27d5c07a6b1]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9b38e38-e5b5-4b90-8dab-15a0b5609322 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:55 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13 Sep 10 18:28:55 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:56 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9b38e38-e5b5-4b90-8dab-15a0b5609322 Sep 10 18:28:56 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:56 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13" returned: 0 in 0.439s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:28:56 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a5ba9d-5bde-403b-adeb-352da90e8f6e]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:56 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca Sep 10 18:28:56 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:56 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9b38e38-e5b5-4b90-8dab-15a0b5609322" returned: 0 in 0.544s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9b38e38-e5b5-4b90-8dab-15a0b5609322 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:56 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9b38e38-e5b5-4b90-8dab-15a0b5609322 Sep 10 18:28:56 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:56 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca" returned: 0 in 0.453s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:28:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:56 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a9b38e38-e5b5-4b90-8dab-15a0b5609322" returned: 0 in 0.335s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:56 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13 Sep 10 18:28:56 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:56 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Lock "cinder-quobyte-a9b38e38-e5b5-4b90-8dab-15a0b5609322" released by "delete_volume" :: held 0.948s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:56 devstack cinder-volume[87842]: WARNING cinder.quota [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:28:56 devstack cinder-volume[87842]: WARNING cinder.quota [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:28:56 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Created reservations ['5738ac04-fe6b-4beb-bf2f-b682e4f2e221', 'db900216-63e6-4e09-9bfe-ebe4e52b682d', 'b4f03b4b-d182-4fc4-a37e-0aac28d1950a', '64d0bda7-3d04-4499-bb70-677b495fe40b'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:57 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:28:57 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Flow 'volume_create_manager' (79693a8c-891c-4dee-8430-1a814f2fc648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ce6b13-696b-4244-a6b9-9821de7a374a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ce6b13-696b-4244-a6b9-9821de7a374a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-129969435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e20964ae34a24e53a761285adfa44fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:57Z,use_quota=True,user_id='b52c4aee3e464577882f22cf85158e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee67ced6-831a-4bff-8015-c411a8287a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee67ced6-831a-4bff-8015-c411a8287a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab08d0b6-c2d0-4a2a-a12d-df7c4f4b87dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.image.glance [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Creating Keystone auth plugin from conf {{(pid=87842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 18:28:57 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13" returned: 0 in 0.527s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:57 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13 Sep 10 18:28:57 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:57 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.328s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:28:57 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Deleted volume successfully. Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-011ed546-ee5b-4e5f-bc27-4ef044b44fa1 tempest-VolumeRetypeWithoutMigrationTest-1481239042 None] Lock "cinder-a9b38e38-e5b5-4b90-8dab-15a0b5609322-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab08d0b6-c2d0-4a2a-a12d-df7c4f4b87dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6', 'volume_name': 'volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6', 'volume_size': 1, 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12fe9fd924464f1896748c45b7609239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'created_at': datetime.datetime(2026, 9, 10, 16, 14, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 14, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0312d110-0baa-405f-96b9-31d6f3adc458/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:57 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31cef343-0d92-47aa-bee7-eff8ed76f136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31cef343-0d92-47aa-bee7-eff8ed76f136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b8ddb5-2c06-459b-965d-4bd75839079b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:28:57 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Volume 31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6', 'volume_size': 1, 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12fe9fd924464f1896748c45b7609239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'created_at': datetime.datetime(2026, 9, 10, 16, 14, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 14, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0312d110-0baa-405f-96b9-31d6f3adc458/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Trying to clone 31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 from image 0312d110-0baa-405f-96b9-31d6f3adc458 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]). {{(pid=87842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.00b58c26-12b9-4c28-b285-a0cbdad52a13" returned: 0 in 0.293s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-quobyte-00b58c26-12b9-4c28-b285-a0cbdad52a13" released by "_delete_snapshot" :: held 1.866s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-quobyte-d0f81377-0e4e-4d7e-9306-9ccd398af17b" released by "delete_snapshot" :: held 1.904s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] Created reservations ['fe7ffbc0-7745-4582-bb55-701095234bd9', '76332058-f00d-499f-aa7a-cdf70ac56a1e', 'e4c071d3-52b2-4d95-bd6e-c0b0b187ad65', '68ff2f04-4aa9-432b-9081-4b9166b5f382'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:28:57 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] Delete snapshot completed successfully. Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-68a91353-1b89-4d87-b1e8-ddbafe1850f7 tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-00b58c26-12b9-4c28-b285-a0cbdad52a13-delete_snapshot" released by "delete_snapshot" :: held 2.203s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458__siokachdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 18:28:57 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Image download 20.69 MB at 20.69 MB/s Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3bbeb8-a155-46a3-b640-f606a5e354ff]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458__siokachdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:58 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458__siokachdevstack@QuobyteHD Sep 10 18:28:58 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:58 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458__siokachdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:58 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Temporary image 0312d110-0baa-405f-96b9-31d6f3adc458 is fetched for user b52c4aee3e464577882f22cf85158e32. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 18:28:58 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[27006cc7-e2ab-40b9-8306-dcb42529b1df]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:28:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458__siokachdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:58 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458__siokachdevstack@QuobyteHD Sep 10 18:28:58 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:58 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458__siokachdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-129969435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e20964ae34a24e53a761285adfa44fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:28:57Z,use_quota=True,user_id='b52c4aee3e464577882f22cf85158e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:28:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Creating volume 31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:28:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:28:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:28:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:28:58 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:28:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:58 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 1073741824 Sep 10 18:28:58 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a8476a43-54f9-4c2d-bc11-0d0084da6763 tempest-SnapshotsActionsTest-713773610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:28:59 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 1073741824" returned: 0 in 0.707s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:28:59 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 Sep 10 18:28:59 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:28:59 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Sep 10 18:28:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6" returned: 0 in 0.359s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:28:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:28:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:28:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a8476a43-54f9-4c2d-bc11-0d0084da6763 tempest-SnapshotsActionsTest-713773610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.565s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:28:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-a8476a43-54f9-4c2d-bc11-0d0084da6763 tempest-SnapshotsActionsTest-713773610 None] Creating offline snapshot cebc84bf-0672-4e73-a07f-711e55327bce of volume d0f81377-0e4e-4d7e-9306-9ccd398af17b {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:29:00 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8ffdf3-5b98-4331-9f17-6f07256679d9]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a8476a43-54f9-4c2d-bc11-0d0084da6763 tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:00 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Attempting download of 0312d110-0baa-405f-96b9-31d6f3adc458 ((None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}])) to volume 31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 18:29:00 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7bef61-9201-4992-94ce-af9fc2741169]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_pjftqc8a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:00 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca Sep 10 18:29:00 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:00 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_pjftqc8a Sep 10 18:29:00 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:00 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_pjftqc8a" returned: 0 in 0.411s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_pjftqc8a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:00 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a8476a43-54f9-4c2d-bc11-0d0084da6763 tempest-SnapshotsActionsTest-713773610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca" returned: 0 in 0.649s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:00 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-a8476a43-54f9-4c2d-bc11-0d0084da6763 tempest-SnapshotsActionsTest-713773610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:29:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a8476a43-54f9-4c2d-bc11-0d0084da6763 tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:00 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce 1G Sep 10 18:29:00 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:00 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_pjftqc8a Sep 10 18:29:00 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:01 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_pjftqc8a" returned: 1 in 0.723s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_pjftqc8a' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:29:01 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[213ed8e5-8005-4744-802d-12f6d46d81c8]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458__siokachdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:01 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a8476a43-54f9-4c2d-bc11-0d0084da6763 tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce 1G" returned: 0 in 0.669s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a8476a43-54f9-4c2d-bc11-0d0084da6763 tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:01 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce Sep 10 18:29:01 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:01 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458__siokachdevstack@QuobyteHD Sep 10 18:29:01 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:01 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458__siokachdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:01 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] 0312d110-0baa-405f-96b9-31d6f3adc458 was qcow2, converting to qcow2 {{(pid=87842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 18:29:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458__siokachdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:01 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a8476a43-54f9-4c2d-bc11-0d0084da6763 tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce" returned: 0 in 0.385s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:01 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-a8476a43-54f9-4c2d-bc11-0d0084da6763 tempest-SnapshotsActionsTest-713773610 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce is being set with open permissions: ugo+rw Sep 10 18:29:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a8476a43-54f9-4c2d-bc11-0d0084da6763 tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:01 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458__siokachdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 Sep 10 18:29:01 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:01 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce Sep 10 18:29:01 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:02 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a8476a43-54f9-4c2d-bc11-0d0084da6763 tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce" returned: 0 in 0.316s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a8476a43-54f9-4c2d-bc11-0d0084da6763 tempest-SnapshotsActionsTest-713773610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.168s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:02 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-a8476a43-54f9-4c2d-bc11-0d0084da6763 tempest-SnapshotsActionsTest-713773610 None] Create snapshot completed successfully Sep 10 18:29:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] Acquiring lock "cinder-cebc84bf-0672-4e73-a07f-711e55327bce-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-cebc84bf-0672-4e73-a07f-711e55327bce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] Acquiring lock "cinder-quobyte-d0f81377-0e4e-4d7e-9306-9ccd398af17b" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-quobyte-d0f81377-0e4e-4d7e-9306-9ccd398af17b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] Acquiring lock "cinder-quobyte-cebc84bf-0672-4e73-a07f-711e55327bce" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-quobyte-cebc84bf-0672-4e73-a07f-711e55327bce" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] Deleting offline snapshot cebc84bf-0672-4e73-a07f-711e55327bce of volume d0f81377-0e4e-4d7e-9306-9ccd398af17b {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:29:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] snapshot_file for this snap is: volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:29:02 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acb4a19-559c-4381-97ca-455a44979424]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:03 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce Sep 10 18:29:03 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:03 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce" returned: 0 in 0.552s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:29:03 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[260def93-fd44-4c92-acfa-9e801c663222]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:03 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca Sep 10 18:29:03 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:04 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca" returned: 0 in 0.750s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:04 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:29:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:04 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce Sep 10 18:29:04 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:04 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458__siokachdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6" returned: 0 in 2.851s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:04 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458__siokachdevstack@QuobyteHD, size 112.00 MB, duration 2.85 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:29:04 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Converted 112.00 MB image at 39.27 MB/s Sep 10 18:29:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:04 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 1G Sep 10 18:29:04 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:05 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce" returned: 0 in 0.896s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:05 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce Sep 10 18:29:05 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:05 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 1G" returned: 0 in 0.683s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:05 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Downloaded image 0312d110-0baa-405f-96b9-31d6f3adc458 ((None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}])) to volume 31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 successfully. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 18:29:05 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Temporary image 0312d110-0baa-405f-96b9-31d6f3adc458 for user b52c4aee3e464577882f22cf85158e32 is deleted. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 18:29:05 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Marking volume 31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 as bootable. {{(pid=87842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 18:29:05 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Copying metadata from image 0312d110-0baa-405f-96b9-31d6f3adc458 to 31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6. {{(pid=87842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 18:29:05 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Creating volume glance metadata for volume 31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 backed by image 0312d110-0baa-405f-96b9-31d6f3adc458 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 18:29:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b8ddb5-2c06-459b-965d-4bd75839079b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6', 'volume_size': 1, 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12fe9fd924464f1896748c45b7609239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'created_at': datetime.datetime(2026, 9, 10, 16, 14, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 14, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0312d110-0baa-405f-96b9-31d6f3adc458/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc220b60-63a7-4314-b4ec-60a3e8649cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:05 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Volume volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 (31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6): created successfully Sep 10 18:29:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc220b60-63a7-4314-b4ec-60a3e8649cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Flow 'volume_create_manager' (79693a8c-891c-4dee-8430-1a814f2fc648) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:29:05 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-a50e4874-7b10-4f33-8200-a5734c6014c7 tempest-VolumesGetTest-1191421110 None] Created volume successfully. Sep 10 18:29:05 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.cebc84bf-0672-4e73-a07f-711e55327bce" returned: 0 in 0.433s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:05 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-quobyte-cebc84bf-0672-4e73-a07f-711e55327bce" released by "_delete_snapshot" :: held 2.878s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:05 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-quobyte-d0f81377-0e4e-4d7e-9306-9ccd398af17b" released by "delete_snapshot" :: held 2.918s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:05 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] Created reservations ['44dce160-fdbf-4f6e-b382-b19825f3d8c9', '33419c4b-e082-4a21-8d0b-f39b5f239a82', '193dcacf-c7c1-48cb-964f-4d82c7d929c4', '35a19fa5-8d99-4eec-80d9-5d3267b485d7'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:29:06 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] Delete snapshot completed successfully. Sep 10 18:29:06 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-efd5db04-d11a-4a20-9a64-09b442d3e894 tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-cebc84bf-0672-4e73-a07f-711e55327bce-delete_snapshot" released by "delete_snapshot" :: held 3.324s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c0af5cba-18dd-455b-8d29-ab8c10c6b13c tempest-SnapshotsActionsTest-713773610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c0af5cba-18dd-455b-8d29-ab8c10c6b13c tempest-SnapshotsActionsTest-713773610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:06 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c0af5cba-18dd-455b-8d29-ab8c10c6b13c tempest-SnapshotsActionsTest-713773610 None] Creating offline snapshot 0c66a8eb-cfde-427e-9510-c275f5dd8d33 of volume d0f81377-0e4e-4d7e-9306-9ccd398af17b {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:29:06 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e80e27d-878f-4660-9ebc-ecdcd0260902]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c0af5cba-18dd-455b-8d29-ab8c10c6b13c tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:06 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca Sep 10 18:29:06 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:07 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:07 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:29:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Flow 'volume_create_manager' (8b07f6f9-8d11-44b7-9c99-324203567fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:29:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdba272a-8c65-483e-b387-a0b98fd825da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c0af5cba-18dd-455b-8d29-ab8c10c6b13c tempest-SnapshotsActionsTest-713773610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca" returned: 0 in 0.871s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:07 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c0af5cba-18dd-455b-8d29-ab8c10c6b13c tempest-SnapshotsActionsTest-713773610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:29:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c0af5cba-18dd-455b-8d29-ab8c10c6b13c tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdba272a-8c65-483e-b387-a0b98fd825da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:29:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-409318159',display_name='tempest-VolumesGetTest-Volume-326979972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a70e11-35d5-41d8-b8f8-e0a1475216e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20964ae34a24e53a761285adfa44fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:29:07Z,use_quota=True,user_id='b52c4aee3e464577882f22cf85158e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:07 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33 1G Sep 10 18:29:07 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2dce7e6-67de-47a4-a8bb-8abfe974fa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2dce7e6-67de-47a4-a8bb-8abfe974fa33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ded149-53f1-43a1-b1ad-802bcebe9f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ded149-53f1-43a1-b1ad-802bcebe9f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17a70e11-35d5-41d8-b8f8-e0a1475216e2', 'volume_name': 'volume-17a70e11-35d5-41d8-b8f8-e0a1475216e2', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c4a5e8-a078-4e82-a744-29bd8970b8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c4a5e8-a078-4e82-a744-29bd8970b8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6458df6d-f940-4dbb-9e6c-626528864bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:07 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Volume 17a70e11-35d5-41d8-b8f8-e0a1475216e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17a70e11-35d5-41d8-b8f8-e0a1475216e2', 'volume_size': 1} Sep 10 18:29:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:08 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c0af5cba-18dd-455b-8d29-ab8c10c6b13c tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33 1G" returned: 0 in 0.934s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c0af5cba-18dd-455b-8d29-ab8c10c6b13c tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:08 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33 Sep 10 18:29:08 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:08 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:29:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Flow 'volume_create_manager' (8159cde3-a555-461e-a515-776c4c3a7b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:29:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e275250a-caf4-4c30-b222-a1cf6fc99cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e275250a-caf4-4c30-b222-a1cf6fc99cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1037499908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae100010-83d0-485d-8daa-1cb52f832602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa01385988649c18214005feb1a1657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:29:09Z,use_quota=True,user_id='53905d235d53448bbab6ae6da6e754ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8200a94-6bab-4dc0-a675-39094a319b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8200a94-6bab-4dc0-a675-39094a319b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155a9eac-1e4c-4a27-8aa0-e1e7cd2dfc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155a9eac-1e4c-4a27-8aa0-e1e7cd2dfc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae100010-83d0-485d-8daa-1cb52f832602', 'volume_name': 'volume-ae100010-83d0-485d-8daa-1cb52f832602', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f74e48-b2ec-4587-a840-c1a21e0b81f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f74e48-b2ec-4587-a840-c1a21e0b81f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bffac38-0c70-45b2-bf8c-bc5e26eb278d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:08 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Volume ae100010-83d0-485d-8daa-1cb52f832602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae100010-83d0-485d-8daa-1cb52f832602', 'volume_size': 1} Sep 10 18:29:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:08 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c0af5cba-18dd-455b-8d29-ab8c10c6b13c tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33" returned: 0 in 0.435s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:08 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-c0af5cba-18dd-455b-8d29-ab8c10c6b13c tempest-SnapshotsActionsTest-713773610 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33 is being set with open permissions: ugo+rw Sep 10 18:29:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c0af5cba-18dd-455b-8d29-ab8c10c6b13c tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:08 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33 Sep 10 18:29:08 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:09 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c0af5cba-18dd-455b-8d29-ab8c10c6b13c tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33" returned: 0 in 0.267s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c0af5cba-18dd-455b-8d29-ab8c10c6b13c tempest-SnapshotsActionsTest-713773610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.686s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.512s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:29:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-409318159',display_name='tempest-VolumesGetTest-Volume-326979972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a70e11-35d5-41d8-b8f8-e0a1475216e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20964ae34a24e53a761285adfa44fd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:29:07Z,use_quota=True,user_id='b52c4aee3e464577882f22cf85158e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:29:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Creating volume 17a70e11-35d5-41d8-b8f8-e0a1475216e2 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:29:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:29:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:29:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:29:09 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:29:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-17a70e11-35d5-41d8-b8f8-e0a1475216e2 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:09 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-17a70e11-35d5-41d8-b8f8-e0a1475216e2 1073741824 Sep 10 18:29:09 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:09 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c0af5cba-18dd-455b-8d29-ab8c10c6b13c tempest-SnapshotsActionsTest-713773610 None] Create snapshot completed successfully Sep 10 18:29:09 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-17a70e11-35d5-41d8-b8f8-e0a1475216e2 1073741824" returned: 0 in 0.473s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-17a70e11-35d5-41d8-b8f8-e0a1475216e2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:09 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-17a70e11-35d5-41d8-b8f8-e0a1475216e2 Sep 10 18:29:09 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:10 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-17a70e11-35d5-41d8-b8f8-e0a1475216e2" returned: 0 in 0.252s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.285s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1037499908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae100010-83d0-485d-8daa-1cb52f832602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa01385988649c18214005feb1a1657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:29:09Z,use_quota=True,user_id='53905d235d53448bbab6ae6da6e754ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Creating volume ae100010-83d0-485d-8daa-1cb52f832602 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:29:10 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ae100010-83d0-485d-8daa-1cb52f832602 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6458df6d-f940-4dbb-9e6c-626528864bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17a70e11-35d5-41d8-b8f8-e0a1475216e2', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:10 devstack sudo[99389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ae100010-83d0-485d-8daa-1cb52f832602 1073741824 Sep 10 18:29:10 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3170da3b-c28a-4693-91e6-814495a662c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:10 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Volume volume-17a70e11-35d5-41d8-b8f8-e0a1475216e2 (17a70e11-35d5-41d8-b8f8-e0a1475216e2): created successfully Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3170da3b-c28a-4693-91e6-814495a662c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Flow 'volume_create_manager' (8b07f6f9-8d11-44b7-9c99-324203567fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:29:10 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-9d6b588d-331b-45dc-8d1b-5d7580eac387 tempest-VolumesGetTest-1191421110 None] Created volume successfully. Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] Acquiring lock "cinder-0c66a8eb-cfde-427e-9510-c275f5dd8d33-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-0c66a8eb-cfde-427e-9510-c275f5dd8d33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] Acquiring lock "cinder-quobyte-d0f81377-0e4e-4d7e-9306-9ccd398af17b" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-quobyte-d0f81377-0e4e-4d7e-9306-9ccd398af17b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] Acquiring lock "cinder-quobyte-0c66a8eb-cfde-427e-9510-c275f5dd8d33" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-quobyte-0c66a8eb-cfde-427e-9510-c275f5dd8d33" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] Deleting offline snapshot 0c66a8eb-cfde-427e-9510-c275f5dd8d33 of volume d0f81377-0e4e-4d7e-9306-9ccd398af17b {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] snapshot_file for this snap is: volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d46d0c-c560-4ab0-a273-c4582277d0e2]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:10 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33 Sep 10 18:29:10 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:10 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ae100010-83d0-485d-8daa-1cb52f832602 1073741824" returned: 0 in 0.610s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ae100010-83d0-485d-8daa-1cb52f832602 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] Acquiring lock "cinder-17a70e11-35d5-41d8-b8f8-e0a1475216e2-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:10 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ae100010-83d0-485d-8daa-1cb52f832602 Sep 10 18:29:10 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] Lock "cinder-17a70e11-35d5-41d8-b8f8-e0a1475216e2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] Acquiring lock "cinder-quobyte-17a70e11-35d5-41d8-b8f8-e0a1475216e2" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] Lock "cinder-quobyte-17a70e11-35d5-41d8-b8f8-e0a1475216e2" acquired by "delete_volume" :: waited 0.024s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a1396a-e3f5-4580-8230-86134d9d3c18]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-17a70e11-35d5-41d8-b8f8-e0a1475216e2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:10 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33" returned: 0 in 0.511s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c238bcf5-c0f0-494c-800a-10513eb6308f]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:11 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-17a70e11-35d5-41d8-b8f8-e0a1475216e2 Sep 10 18:29:11 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:11 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ae100010-83d0-485d-8daa-1cb52f832602" returned: 0 in 0.347s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bffac38-0c70-45b2-bf8c-bc5e26eb278d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae100010-83d0-485d-8daa-1cb52f832602', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882d2b9f-dc2e-4453-992c-74a3588aa72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:11 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Volume volume-ae100010-83d0-485d-8daa-1cb52f832602 (ae100010-83d0-485d-8daa-1cb52f832602): created successfully Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882d2b9f-dc2e-4453-992c-74a3588aa72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Flow 'volume_create_manager' (8159cde3-a555-461e-a515-776c4c3a7b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:29:11 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca Sep 10 18:29:11 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:11 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f8835adb-a080-4d27-96a5-f107303886ab tempest-VolumesServicesTestJSON-232633461 None] Created volume successfully. Sep 10 18:29:11 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-17a70e11-35d5-41d8-b8f8-e0a1475216e2" returned: 0 in 0.406s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-17a70e11-35d5-41d8-b8f8-e0a1475216e2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:11 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-17a70e11-35d5-41d8-b8f8-e0a1475216e2 Sep 10 18:29:11 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:11 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca" returned: 0 in 0.481s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:11 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33 Sep 10 18:29:11 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:11 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-17a70e11-35d5-41d8-b8f8-e0a1475216e2" returned: 0 in 0.270s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] Lock "cinder-quobyte-17a70e11-35d5-41d8-b8f8-e0a1475216e2" released by "delete_volume" :: held 0.730s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] Created reservations ['e178c581-7add-4af3-89d9-8c1c1125ca0d', 'b77f948a-6b0a-44cd-bba1-f2c307c0590f', '034853d8-fc2a-4b55-bf33-a3abda19e490', '91cedb72-f9e4-43e1-9320-d6052a762a87'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:11 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:29:11 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:11 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] Acquiring lock "cinder-ae100010-83d0-485d-8daa-1cb52f832602-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33" returned: 0 in 0.555s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] Lock "cinder-ae100010-83d0-485d-8daa-1cb52f832602-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:12 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33 Sep 10 18:29:12 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] Acquiring lock "cinder-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] Lock "cinder-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] Acquiring lock "cinder-quobyte-ae100010-83d0-485d-8daa-1cb52f832602" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] Acquiring lock "cinder-quobyte-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] Lock "cinder-quobyte-ae100010-83d0-485d-8daa-1cb52f832602" acquired by "delete_volume" :: waited 0.039s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] Lock "cinder-quobyte-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6" acquired by "delete_volume" :: waited 0.032s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af4fe11-3cba-4ae4-ae9c-cf4eb3d89b1d]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ae100010-83d0-485d-8daa-1cb52f832602 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d89b9d1-1201-4702-ba1f-65c45b23d6cb]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:12 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.546s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:29:12 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] Deleted volume successfully. Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f3d58b10-8389-421a-9f37-44ac8202f253 tempest-VolumesGetTest-1191421110 None] Lock "cinder-17a70e11-35d5-41d8-b8f8-e0a1475216e2-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:12 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 Sep 10 18:29:12 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:12 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ae100010-83d0-485d-8daa-1cb52f832602 Sep 10 18:29:12 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:12 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.0c66a8eb-cfde-427e-9510-c275f5dd8d33" returned: 0 in 0.470s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-quobyte-0c66a8eb-cfde-427e-9510-c275f5dd8d33" released by "_delete_snapshot" :: held 2.122s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-quobyte-d0f81377-0e4e-4d7e-9306-9ccd398af17b" released by "delete_snapshot" :: held 2.151s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] Created reservations ['ff458974-f342-4b31-9fd6-7ffde3cbfb41', 'd3448ca3-d715-492e-ace0-626b4d73a8a4', 'cf37f8e6-9353-48b3-a0ab-491a2ed8a3cc', 'c80d2539-e95a-48ef-a857-b8c41877de0a'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:29:12 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6" returned: 0 in 0.441s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:12 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6 Sep 10 18:29:12 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:12 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] Delete snapshot completed successfully. Sep 10 18:29:12 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3f1c1cd7-3227-4220-a650-011fad4286f9 tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-0c66a8eb-cfde-427e-9510-c275f5dd8d33-delete_snapshot" released by "delete_snapshot" :: held 2.414s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ae100010-83d0-485d-8daa-1cb52f832602" returned: 0 in 0.530s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ae100010-83d0-485d-8daa-1cb52f832602 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:12 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ae100010-83d0-485d-8daa-1cb52f832602 Sep 10 18:29:12 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:12 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6" returned: 0 in 0.319s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] Lock "cinder-quobyte-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6" released by "delete_volume" :: held 0.815s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:13 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ae100010-83d0-485d-8daa-1cb52f832602" returned: 0 in 0.287s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] Lock "cinder-quobyte-ae100010-83d0-485d-8daa-1cb52f832602" released by "delete_volume" :: held 0.874s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] Created reservations ['c15bc85f-58c0-49ba-895d-2b3ebf06363a', '9becc044-e90b-453d-b9eb-a03dea23fedd', '9eae2cf5-8a60-4b13-a811-18aff71704a4', '580062c3-05c8-4c6d-9cac-33f7e250d281'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] Created reservations ['a0128480-a4ee-4859-8fd5-54d40cd9df25', '623c2920-26b6-49d6-9cd8-abeaa1fc3a36', '359a5396-bb42-43ca-af6f-8078385022c7', 'dd85bd54-3193-4638-bacf-619b23a61ce0'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:13 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:29:13 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:13 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:29:13 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:13 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.367s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:29:13 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] Deleted volume successfully. Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-85ce3ec7-524b-4fd0-b4bf-feca27f8de79 tempest-VolumesGetTest-1191421110 None] Lock "cinder-31b8a21d-0c0b-4d0f-a4f2-d4bdd0b4d1d6-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:13 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.464s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:29:13 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] Deleted volume successfully. Sep 10 18:29:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e5410229-7f83-403a-954a-33ebd4a077f4 tempest-VolumesServicesTestJSON-232633461 None] Lock "cinder-ae100010-83d0-485d-8daa-1cb52f832602-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c945ac84-4262-4c21-afa6-b198e1b678d4 tempest-SnapshotsActionsTest-713773610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c945ac84-4262-4c21-afa6-b198e1b678d4 tempest-SnapshotsActionsTest-713773610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c945ac84-4262-4c21-afa6-b198e1b678d4 tempest-SnapshotsActionsTest-713773610 None] Creating offline snapshot fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc of volume d0f81377-0e4e-4d7e-9306-9ccd398af17b {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:29:14 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfdf0b3-c813-4dc9-97ac-a055d5f82b56]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c945ac84-4262-4c21-afa6-b198e1b678d4 tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:14 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca Sep 10 18:29:14 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:14 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c945ac84-4262-4c21-afa6-b198e1b678d4 tempest-SnapshotsActionsTest-713773610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca" returned: 0 in 0.412s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c945ac84-4262-4c21-afa6-b198e1b678d4 tempest-SnapshotsActionsTest-713773610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:29:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c945ac84-4262-4c21-afa6-b198e1b678d4 tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:14 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc 1G Sep 10 18:29:14 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:15 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c945ac84-4262-4c21-afa6-b198e1b678d4 tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc 1G" returned: 0 in 0.582s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c945ac84-4262-4c21-afa6-b198e1b678d4 tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:15 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc Sep 10 18:29:15 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:15 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c945ac84-4262-4c21-afa6-b198e1b678d4 tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc" returned: 0 in 0.409s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:15 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-c945ac84-4262-4c21-afa6-b198e1b678d4 tempest-SnapshotsActionsTest-713773610 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc is being set with open permissions: ugo+rw Sep 10 18:29:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c945ac84-4262-4c21-afa6-b198e1b678d4 tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:15 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc Sep 10 18:29:15 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:15 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c945ac84-4262-4c21-afa6-b198e1b678d4 tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc" returned: 0 in 0.343s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c945ac84-4262-4c21-afa6-b198e1b678d4 tempest-SnapshotsActionsTest-713773610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.909s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:15 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c945ac84-4262-4c21-afa6-b198e1b678d4 tempest-SnapshotsActionsTest-713773610 None] Create snapshot completed successfully Sep 10 18:29:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] Acquiring lock "cinder-fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] Acquiring lock "cinder-quobyte-d0f81377-0e4e-4d7e-9306-9ccd398af17b" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-quobyte-d0f81377-0e4e-4d7e-9306-9ccd398af17b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] Acquiring lock "cinder-quobyte-fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-quobyte-fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] Deleting offline snapshot fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc of volume d0f81377-0e4e-4d7e-9306-9ccd398af17b {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:29:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] snapshot_file for this snap is: volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:29:16 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f1731d-ee0b-415e-a224-ffc0c2ec9b10]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:16 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc Sep 10 18:29:16 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:16 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc" returned: 0 in 0.542s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:29:17 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f6eb91-b623-408c-a75b-13c73ab1f63e]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:17 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca Sep 10 18:29:17 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:17 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca" returned: 0 in 0.498s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:29:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:17 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc Sep 10 18:29:17 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:18 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc" returned: 0 in 0.526s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:18 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc Sep 10 18:29:18 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:18 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc" returned: 0 in 0.371s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-quobyte-fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc" released by "_delete_snapshot" :: held 2.082s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-quobyte-d0f81377-0e4e-4d7e-9306-9ccd398af17b" released by "delete_snapshot" :: held 2.116s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:18 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] Created reservations ['daacc0df-ad70-448b-be52-ad90caca0b9f', 'b66323f3-262d-4216-9c68-7677d37ee41f', '8fe6c557-6177-4488-a34e-6d122c5d75aa', '6d02cbd4-02a4-4072-8107-2c3dbe0da2e7'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:29:18 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] Delete snapshot completed successfully. Sep 10 18:29:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ae0bd3a-e47c-473c-aa6f-f1443e4fea1b tempest-SnapshotsActionsTest-241907346 None] Lock "cinder-fdfed9e2-52d3-4325-8244-f0b3b2f5f0bc-delete_snapshot" released by "delete_snapshot" :: held 2.289s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Flow 'volume_create_manager' (11b2c201-d704-42cf-9811-0743aa390540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1495ec8a-1b43-4526-8414-fd295e7d0e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1495ec8a-1b43-4526-8414-fd295e7d0e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-684151046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ed0b37-dfc0-4a71-9783-03711387909f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='084477eedfa949ee8966a1afbcd3934e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:29:19Z,use_quota=True,user_id='3cbe05c43d974f37b69a9930f6caa5b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381ccfa3-60d1-4761-ab1b-501d29c78899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381ccfa3-60d1-4761-ab1b-501d29c78899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc6fb5b-4e9b-4e55-befd-15d407c8a81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc6fb5b-4e9b-4e55-befd-15d407c8a81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0ed0b37-dfc0-4a71-9783-03711387909f', 'volume_name': 'volume-e0ed0b37-dfc0-4a71-9783-03711387909f', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5216901e-d29e-4f46-9710-35008fa0c4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5216901e-d29e-4f46-9710-35008fa0c4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09e6082-5acd-4f65-9e40-c7232ca2235d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:19 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Volume e0ed0b37-dfc0-4a71-9783-03711387909f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0ed0b37-dfc0-4a71-9783-03711387909f', 'volume_size': 1} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-684151046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ed0b37-dfc0-4a71-9783-03711387909f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='084477eedfa949ee8966a1afbcd3934e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:29:19Z,use_quota=True,user_id='3cbe05c43d974f37b69a9930f6caa5b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Creating volume e0ed0b37-dfc0-4a71-9783-03711387909f {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:29:19 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0ed0b37-dfc0-4a71-9783-03711387909f 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:19 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0ed0b37-dfc0-4a71-9783-03711387909f 1073741824 Sep 10 18:29:19 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:19 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0ed0b37-dfc0-4a71-9783-03711387909f 1073741824" returned: 0 in 0.456s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0ed0b37-dfc0-4a71-9783-03711387909f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:19 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0ed0b37-dfc0-4a71-9783-03711387909f Sep 10 18:29:19 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] Acquiring lock "cinder-8b52a649-7eec-4f2a-aca7-b3523b0336ca-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] Lock "cinder-8b52a649-7eec-4f2a-aca7-b3523b0336ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] Acquiring lock "cinder-quobyte-d0f81377-0e4e-4d7e-9306-9ccd398af17b" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] Lock "cinder-quobyte-d0f81377-0e4e-4d7e-9306-9ccd398af17b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] Acquiring lock "cinder-quobyte-8b52a649-7eec-4f2a-aca7-b3523b0336ca" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] Lock "cinder-quobyte-8b52a649-7eec-4f2a-aca7-b3523b0336ca" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] Deleting offline snapshot 8b52a649-7eec-4f2a-aca7-b3523b0336ca of volume d0f81377-0e4e-4d7e-9306-9ccd398af17b {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] snapshot_file for this snap is: volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[04df9f6e-738c-4471-b64b-d88374b889f6]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:20 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca Sep 10 18:29:20 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:20 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0ed0b37-dfc0-4a71-9783-03711387909f" returned: 0 in 0.302s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09e6082-5acd-4f65-9e40-c7232ca2235d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0ed0b37-dfc0-4a71-9783-03711387909f', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68486db7-4b22-4634-8576-4cbf9084e164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:20 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Volume volume-e0ed0b37-dfc0-4a71-9783-03711387909f (e0ed0b37-dfc0-4a71-9783-03711387909f): created successfully Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68486db7-4b22-4634-8576-4cbf9084e164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Flow 'volume_create_manager' (11b2c201-d704-42cf-9811-0743aa390540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:29:20 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-6e5505bd-022f-468c-a35c-a4ce309d5112 tempest-VolumesListTestJSON-319064748 None] Created volume successfully. Sep 10 18:29:20 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca" returned: 0 in 0.374s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceba8fd-c77b-40b0-b8ca-c3c5604258b3]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:20 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b Sep 10 18:29:20 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:20 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b" returned: 0 in 0.369s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:20 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca Sep 10 18:29:20 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:21 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca" returned: 0 in 0.333s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:21 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca Sep 10 18:29:21 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:21 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b.8b52a649-7eec-4f2a-aca7-b3523b0336ca" returned: 0 in 0.286s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] Lock "cinder-quobyte-8b52a649-7eec-4f2a-aca7-b3523b0336ca" released by "_delete_snapshot" :: held 1.485s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] Lock "cinder-quobyte-d0f81377-0e4e-4d7e-9306-9ccd398af17b" released by "delete_snapshot" :: held 1.512s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Flow 'volume_create_manager' (aeaff278-0434-4b01-8f4c-c46df7dc4537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8543a11f-3571-45f7-92df-f77b67346c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8543a11f-3571-45f7-92df-f77b67346c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1806107428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6310f437ab7541bcbb90d3af8a65681c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:29:22Z,use_quota=True,user_id='2273ada5fe464dee8a5c376b409c2b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723f6719-d1c0-4e24-9b89-d4806e9756e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723f6719-d1c0-4e24-9b89-d4806e9756e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea18202-56b8-4ddc-82a1-5729926ddef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea18202-56b8-4ddc-82a1-5729926ddef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a', 'volume_name': 'volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e696c3eb-12b9-4df8-b986-846d3e961986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e696c3eb-12b9-4df8-b986-846d3e961986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebe7299-cb2a-4900-b901-f557ad866a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:21 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Volume e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a', 'volume_size': 1} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1806107428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6310f437ab7541bcbb90d3af8a65681c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:29:22Z,use_quota=True,user_id='2273ada5fe464dee8a5c376b409c2b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Creating volume e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:29:21 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] Created reservations ['b52051f7-d1e2-4cfc-886b-57f8ebe27655', '82a85d53-a83a-4d40-b22e-6095ea7af80e', 'd86cb7dc-8ed4-4c64-8076-79741b402086', '274196f2-3e48-4695-8a6f-2d5fbe7c77fd'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:29:21 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a 1073741824 Sep 10 18:29:21 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:21 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] Delete snapshot completed successfully. Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ec8c1cde-f467-40ca-b555-51e870ddd49d tempest-SnapshotsActionsTest-713773610 None] Lock "cinder-8b52a649-7eec-4f2a-aca7-b3523b0336ca-delete_snapshot" released by "delete_snapshot" :: held 1.786s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:21 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Flow 'volume_create_manager' (b4e17115-313a-4ed0-a11b-7d62ec413240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ecad83c-dbc0-4103-bcbd-89a7af1b70fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ecad83c-dbc0-4103-bcbd-89a7af1b70fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-240877710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebdffd79-eecf-482d-8d65-224587852aca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='084477eedfa949ee8966a1afbcd3934e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:29:22Z,use_quota=True,user_id='3cbe05c43d974f37b69a9930f6caa5b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e26eb8e-2749-4072-a21a-9ae6aacf50d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e26eb8e-2749-4072-a21a-9ae6aacf50d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460c3de6-b8aa-4149-864d-cf290a359032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460c3de6-b8aa-4149-864d-cf290a359032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebdffd79-eecf-482d-8d65-224587852aca', 'volume_name': 'volume-ebdffd79-eecf-482d-8d65-224587852aca', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (366a804d-a47f-4778-91c1-c277724dba0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (366a804d-a47f-4778-91c1-c277724dba0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e7e235-098b-4b87-9095-84676dc29ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:22 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Volume ebdffd79-eecf-482d-8d65-224587852aca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebdffd79-eecf-482d-8d65-224587852aca', 'volume_size': 1} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:22 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a 1073741824" returned: 0 in 0.474s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] Acquiring lock "cinder-d0f81377-0e4e-4d7e-9306-9ccd398af17b-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] Lock "cinder-d0f81377-0e4e-4d7e-9306-9ccd398af17b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:22 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a Sep 10 18:29:22 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] Acquiring lock "cinder-quobyte-d0f81377-0e4e-4d7e-9306-9ccd398af17b" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] Lock "cinder-quobyte-d0f81377-0e4e-4d7e-9306-9ccd398af17b" acquired by "delete_volume" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c7cd6f-4537-4e47-bcea-ecd4266306c9]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:22 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b Sep 10 18:29:22 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:22 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a" returned: 0 in 0.256s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.384s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-240877710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebdffd79-eecf-482d-8d65-224587852aca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='084477eedfa949ee8966a1afbcd3934e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:29:22Z,use_quota=True,user_id='3cbe05c43d974f37b69a9930f6caa5b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Creating volume ebdffd79-eecf-482d-8d65-224587852aca {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:29:22 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebdffd79-eecf-482d-8d65-224587852aca 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebe7299-cb2a-4900-b901-f557ad866a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2f7309-d2f8-4d70-b376-0ab9750630f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:22 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebdffd79-eecf-482d-8d65-224587852aca 1073741824 Sep 10 18:29:22 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:22 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Volume volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a (e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a): created successfully Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2f7309-d2f8-4d70-b376-0ab9750630f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Flow 'volume_create_manager' (aeaff278-0434-4b01-8f4c-c46df7dc4537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:29:22 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-7c9fdd95-e299-4df6-9285-523561a3beb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Created volume successfully. Sep 10 18:29:22 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b" returned: 0 in 0.367s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:22 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b Sep 10 18:29:22 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:22 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebdffd79-eecf-482d-8d65-224587852aca 1073741824" returned: 0 in 0.442s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:22 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d0f81377-0e4e-4d7e-9306-9ccd398af17b" returned: 0 in 0.264s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] Lock "cinder-quobyte-d0f81377-0e4e-4d7e-9306-9ccd398af17b" released by "delete_volume" :: held 0.688s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebdffd79-eecf-482d-8d65-224587852aca {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:23 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebdffd79-eecf-482d-8d65-224587852aca Sep 10 18:29:23 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] Created reservations ['7fa002a1-97e6-491f-94c9-4da81f06d428', '89b5e5e3-d199-4653-a5b0-76751ed634a6', '2df0dfd3-cabe-4c0b-a03a-be5c6b26ac91', 'd1c21bb4-5310-4a78-9dbb-81d1036de162'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:23 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:29:23 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:23 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebdffd79-eecf-482d-8d65-224587852aca" returned: 0 in 0.251s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e7e235-098b-4b87-9095-84676dc29ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebdffd79-eecf-482d-8d65-224587852aca', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d5d8df-d678-4ef1-bf8f-5f5f81b5153e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:23 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Volume volume-ebdffd79-eecf-482d-8d65-224587852aca (ebdffd79-eecf-482d-8d65-224587852aca): created successfully Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d5d8df-d678-4ef1-bf8f-5f5f81b5153e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Flow 'volume_create_manager' (b4e17115-313a-4ed0-a11b-7d62ec413240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:29:23 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-9d117707-24d0-466d-9ec9-2e2909ad118f tempest-VolumesListTestJSON-319064748 None] Created volume successfully. Sep 10 18:29:23 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.280s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:29:23 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] Deleted volume successfully. Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3939c3c8-6563-484f-9bdf-4de16585ff22 tempest-SnapshotsActionsTest-713773610 None] Lock "cinder-d0f81377-0e4e-4d7e-9306-9ccd398af17b-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c158f1ba-5802-4a60-840e-8a3b378fbae8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c158f1ba-5802-4a60-840e-8a3b378fbae8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c158f1ba-5802-4a60-840e-8a3b378fbae8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Creating offline snapshot 8fa9b6ea-10e0-41ae-9493-7b0d50a1538c of volume e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7babd74-ae8c-4d97-80b1-1f4555a7dfa4]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c158f1ba-5802-4a60-840e-8a3b378fbae8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:24 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a Sep 10 18:29:24 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:24 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c158f1ba-5802-4a60-840e-8a3b378fbae8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a" returned: 0 in 0.488s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c158f1ba-5802-4a60-840e-8a3b378fbae8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:24 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c 1G Sep 10 18:29:24 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:24 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:29:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Flow 'volume_create_manager' (8f7345c1-95ff-4db6-b582-b8d32b545681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:29:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff16c3c1-9fa9-464b-8967-4ed1d579c5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff16c3c1-9fa9-464b-8967-4ed1d579c5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1850571953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b295ad4-d287-4941-bb6c-0a9ace8da51d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='084477eedfa949ee8966a1afbcd3934e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:29:25Z,use_quota=True,user_id='3cbe05c43d974f37b69a9930f6caa5b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e719b28-6c8a-4e66-9838-d5aa0c7a5e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e719b28-6c8a-4e66-9838-d5aa0c7a5e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3299b3a6-f2dd-4ff0-a0b0-a50c48c1e3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3299b3a6-f2dd-4ff0-a0b0-a50c48c1e3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b295ad4-d287-4941-bb6c-0a9ace8da51d', 'volume_name': 'volume-4b295ad4-d287-4941-bb6c-0a9ace8da51d', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade34f9c-ec30-4a3e-b2ec-4cb964651ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade34f9c-ec30-4a3e-b2ec-4cb964651ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6aa9be1-4029-47cd-b72b-25079549626f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:24 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Volume 4b295ad4-d287-4941-bb6c-0a9ace8da51d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b295ad4-d287-4941-bb6c-0a9ace8da51d', 'volume_size': 1} Sep 10 18:29:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:24 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c158f1ba-5802-4a60-840e-8a3b378fbae8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c 1G" returned: 0 in 0.578s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c158f1ba-5802-4a60-840e-8a3b378fbae8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:24 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c Sep 10 18:29:24 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:25 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c158f1ba-5802-4a60-840e-8a3b378fbae8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c" returned: 0 in 0.291s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:25 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-c158f1ba-5802-4a60-840e-8a3b378fbae8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c is being set with open permissions: ugo+rw Sep 10 18:29:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c158f1ba-5802-4a60-840e-8a3b378fbae8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:25 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c Sep 10 18:29:25 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:25 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c158f1ba-5802-4a60-840e-8a3b378fbae8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c" returned: 0 in 0.273s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c158f1ba-5802-4a60-840e-8a3b378fbae8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:25 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.info Sep 10 18:29:25 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:25 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c158f1ba-5802-4a60-840e-8a3b378fbae8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.info" returned: 0 in 0.292s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:25 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-c158f1ba-5802-4a60-840e-8a3b378fbae8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.info is being set with open permissions: ugo+rw Sep 10 18:29:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c158f1ba-5802-4a60-840e-8a3b378fbae8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:25 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.info Sep 10 18:29:25 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:26 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c158f1ba-5802-4a60-840e-8a3b378fbae8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.info" returned: 0 in 0.290s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c158f1ba-5802-4a60-840e-8a3b378fbae8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.327s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.252s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1850571953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b295ad4-d287-4941-bb6c-0a9ace8da51d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='084477eedfa949ee8966a1afbcd3934e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:29:25Z,use_quota=True,user_id='3cbe05c43d974f37b69a9930f6caa5b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Creating volume 4b295ad4-d287-4941-bb6c-0a9ace8da51d {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:29:26 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b295ad4-d287-4941-bb6c-0a9ace8da51d 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:26 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c158f1ba-5802-4a60-840e-8a3b378fbae8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Create snapshot completed successfully Sep 10 18:29:26 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b295ad4-d287-4941-bb6c-0a9ace8da51d 1073741824 Sep 10 18:29:26 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:26 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b295ad4-d287-4941-bb6c-0a9ace8da51d 1073741824" returned: 0 in 0.448s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b295ad4-d287-4941-bb6c-0a9ace8da51d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:26 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b295ad4-d287-4941-bb6c-0a9ace8da51d Sep 10 18:29:26 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:26 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b295ad4-d287-4941-bb6c-0a9ace8da51d" returned: 0 in 0.261s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6aa9be1-4029-47cd-b72b-25079549626f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b295ad4-d287-4941-bb6c-0a9ace8da51d', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69152524-4919-4323-9f2f-5b5252a8326a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:26 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Volume volume-4b295ad4-d287-4941-bb6c-0a9ace8da51d (4b295ad4-d287-4941-bb6c-0a9ace8da51d): created successfully Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69152524-4919-4323-9f2f-5b5252a8326a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Flow 'volume_create_manager' (8f7345c1-95ff-4db6-b582-b8d32b545681) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:29:27 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d48cf341-a4d5-456b-8641-1a47387f652e tempest-VolumesListTestJSON-319064748 None] Created volume successfully. Sep 10 18:29:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Acquiring lock "cinder-8fa9b6ea-10e0-41ae-9493-7b0d50a1538c-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Lock "cinder-8fa9b6ea-10e0-41ae-9493-7b0d50a1538c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Acquiring lock "cinder-quobyte-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Lock "cinder-quobyte-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Acquiring lock "cinder-quobyte-8fa9b6ea-10e0-41ae-9493-7b0d50a1538c" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Lock "cinder-quobyte-8fa9b6ea-10e0-41ae-9493-7b0d50a1538c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Deleting offline snapshot 8fa9b6ea-10e0-41ae-9493-7b0d50a1538c of volume e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:29:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] snapshot_file for this snap is: volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:29:27 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea61102-5a60-4dda-8790-9ca8c6089141]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:27 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c Sep 10 18:29:27 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:27 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c" returned: 0 in 0.413s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:29:27 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1f1fc9-9d9c-4134-a56b-f9a5fe3c8612]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:28 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a Sep 10 18:29:28 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:28 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a" returned: 0 in 0.375s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:28 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c Sep 10 18:29:28 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:28 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c" returned: 0 in 0.464s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:28 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c Sep 10 18:29:28 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:29 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:29:29 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:29 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a.8fa9b6ea-10e0-41ae-9493-7b0d50a1538c" returned: 0 in 0.358s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Lock "cinder-quobyte-8fa9b6ea-10e0-41ae-9493-7b0d50a1538c" released by "_delete_snapshot" :: held 1.761s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Lock "cinder-quobyte-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a" released by "delete_snapshot" :: held 1.785s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Created reservations ['6496a989-12d4-4bcf-b7b0-495cea908d97', 'cc58ad82-e3fb-4860-8126-c9726b91cdd4', '17441018-be1c-45e7-a46a-f4680fa4b73e', 'de7af2b5-2587-4e52-82a0-6103056be1cd'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:29:29 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.309s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 28 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:29:29 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Delete snapshot completed successfully. Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5f865fad-4b87-45a7-bf19-a6fe3232d5d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Lock "cinder-8fa9b6ea-10e0-41ae-9493-7b0d50a1538c-delete_snapshot" released by "delete_snapshot" :: held 1.966s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Acquiring lock "cinder-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Lock "cinder-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Acquiring lock "cinder-quobyte-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Lock "cinder-quobyte-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a" acquired by "delete_volume" :: waited 0.040s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3881198e-0273-4357-8516-3a0eeda44b29]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Flow 'volume_create_manager' (5850f51d-46f0-4661-a11f-6a0887b20d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d5d809-0d05-45fd-895c-90dc8b2d45bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d5d809-0d05-45fd-895c-90dc8b2d45bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1703241330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9736333-77b1-41fb-b486-ad46503d9fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f698e4f9b6b54d04a84bf222637f6995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:29:30Z,use_quota=True,user_id='fc2a3517af644d35afdebfd0d8b7c88e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a6c7342-5d9a-4481-af3d-24d492a60905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a6c7342-5d9a-4481-af3d-24d492a60905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3373058b-17af-46f4-9a70-0788d7fa2621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3373058b-17af-46f4-9a70-0788d7fa2621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9736333-77b1-41fb-b486-ad46503d9fc2', 'volume_name': 'volume-c9736333-77b1-41fb-b486-ad46503d9fc2', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffaa9666-cdeb-47e5-9da9-9bafdc34c903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffaa9666-cdeb-47e5-9da9-9bafdc34c903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a0360b-0700-49f5-be83-1de3fa2f7bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:30 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Volume c9736333-77b1-41fb-b486-ad46503d9fc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9736333-77b1-41fb-b486-ad46503d9fc2', 'volume_size': 1} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1703241330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9736333-77b1-41fb-b486-ad46503d9fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f698e4f9b6b54d04a84bf222637f6995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:29:30Z,use_quota=True,user_id='fc2a3517af644d35afdebfd0d8b7c88e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Creating volume c9736333-77b1-41fb-b486-ad46503d9fc2 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:29:30 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c9736333-77b1-41fb-b486-ad46503d9fc2 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:30 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c9736333-77b1-41fb-b486-ad46503d9fc2 1073741824 Sep 10 18:29:30 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:30 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a Sep 10 18:29:30 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:30 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a" returned: 0 in 0.554s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:30 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a Sep 10 18:29:30 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:30 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c9736333-77b1-41fb-b486-ad46503d9fc2 1073741824" returned: 0 in 0.649s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c9736333-77b1-41fb-b486-ad46503d9fc2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:30 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c9736333-77b1-41fb-b486-ad46503d9fc2 Sep 10 18:29:30 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:30 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a" returned: 0 in 0.371s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Lock "cinder-quobyte-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a" released by "delete_volume" :: held 1.012s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] Acquiring lock "cinder-4b295ad4-d287-4941-bb6c-0a9ace8da51d-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=162,cinder:UPDATE=187,cinder:INSERT=51,cinder:DELETE=15 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] Lock "cinder-4b295ad4-d287-4941-bb6c-0a9ace8da51d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:UPDATE=184,cinder:DELETE=14,cinder:SELECT=147,cinder:INSERT=52 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] Acquiring lock "cinder-quobyte-4b295ad4-d287-4941-bb6c-0a9ace8da51d" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Created reservations ['d557b19d-a83c-4051-b00f-00fd1c46f75a', 'ddd857a9-de90-4fd2-bfc2-c8cb51a13821', 'b4bd6897-8c08-461e-a184-5e1fba5dac72', '10f5bf80-cf86-4bd6-b165-0edb02c81d70'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] Lock "cinder-quobyte-4b295ad4-d287-4941-bb6c-0a9ace8da51d" acquired by "delete_volume" :: waited 0.030s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a51d542-a1a3-4d25-80c3-d23df85c2488]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b295ad4-d287-4941-bb6c-0a9ace8da51d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:29:31 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c9736333-77b1-41fb-b486-ad46503d9fc2" returned: 0 in 0.378s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:31 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:29:31 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a0360b-0700-49f5-be83-1de3fa2f7bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9736333-77b1-41fb-b486-ad46503d9fc2', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e30dffa-839a-4f09-9c09-ca285fc9a94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:31 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Volume volume-c9736333-77b1-41fb-b486-ad46503d9fc2 (c9736333-77b1-41fb-b486-ad46503d9fc2): created successfully Sep 10 18:29:31 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b295ad4-d287-4941-bb6c-0a9ace8da51d Sep 10 18:29:31 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e30dffa-839a-4f09-9c09-ca285fc9a94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Flow 'volume_create_manager' (5850f51d-46f0-4661-a11f-6a0887b20d80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:29:31 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-6ee11277-1caa-4444-a935-c8a0c49b6c62 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Created volume successfully. Sep 10 18:29:31 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.305s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:29:31 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Deleted volume successfully. Sep 10 18:29:31 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-67870d9d-2844-4cb6-af74-b87ca52f9272 tempest-VolumeSnapshotQuotasNegativeTestJSON-1315442862 None] Lock "cinder-e805c6e3-9b8d-4fd0-a1ef-c65e5e1c672a-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b295ad4-d287-4941-bb6c-0a9ace8da51d" returned: 0 in 0.435s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b295ad4-d287-4941-bb6c-0a9ace8da51d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:31 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b295ad4-d287-4941-bb6c-0a9ace8da51d Sep 10 18:29:31 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:31 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b295ad4-d287-4941-bb6c-0a9ace8da51d" returned: 0 in 0.267s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] Lock "cinder-quobyte-4b295ad4-d287-4941-bb6c-0a9ace8da51d" released by "delete_volume" :: held 0.747s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:31 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] Created reservations ['48ac4599-4d96-48d8-ada6-af191a3040df', '8674d7b4-604b-4343-83fe-8f806829efaa', '1d15edb6-a7ee-4d39-bf5d-326e72a69995', '6092cca4-e6eb-4564-9043-7632bcd16a19'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:29:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:29:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:29:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:32 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:29:32 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] Acquiring lock "cinder-ebdffd79-eecf-482d-8d65-224587852aca-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] Lock "cinder-ebdffd79-eecf-482d-8d65-224587852aca-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] Acquiring lock "cinder-quobyte-ebdffd79-eecf-482d-8d65-224587852aca" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:32 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.409s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:32 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:29:32 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] Deleted volume successfully. Sep 10 18:29:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] Lock "cinder-quobyte-ebdffd79-eecf-482d-8d65-224587852aca" acquired by "delete_volume" :: waited 0.039s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4d66ca22-444d-40c3-9037-b4ba8f866847 tempest-VolumesListTestJSON-319064748 None] Lock "cinder-4b295ad4-d287-4941-bb6c-0a9ace8da51d-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:32 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f0ab2d-84cd-41ea-ab8e-0bc409b78bc6]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebdffd79-eecf-482d-8d65-224587852aca {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:32 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebdffd79-eecf-482d-8d65-224587852aca Sep 10 18:29:32 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:33 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebdffd79-eecf-482d-8d65-224587852aca" returned: 0 in 0.486s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebdffd79-eecf-482d-8d65-224587852aca {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:33 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebdffd79-eecf-482d-8d65-224587852aca Sep 10 18:29:33 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-2f551c6a-0eb7-4ecb-8196-1b2f77eba480 req-84c95736-72ff-4e43-8313-eaaba8bd8593 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-2f551c6a-0eb7-4ecb-8196-1b2f77eba480 req-84c95736-72ff-4e43-8313-eaaba8bd8593 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-2f551c6a-0eb7-4ecb-8196-1b2f77eba480 req-84c95736-72ff-4e43-8313-eaaba8bd8593 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-2f551c6a-0eb7-4ecb-8196-1b2f77eba480 req-84c95736-72ff-4e43-8313-eaaba8bd8593 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-c9736333-77b1-41fb-b486-ad46503d9fc2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1aee15a-dcf0-4e5e-9cac-bd132d5b13c4', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:29:33 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:33 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-2f551c6a-0eb7-4ecb-8196-1b2f77eba480 req-84c95736-72ff-4e43-8313-eaaba8bd8593 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] attachment_update completed successfully. Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebdffd79-eecf-482d-8d65-224587852aca" returned: 0 in 0.302s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] Lock "cinder-quobyte-ebdffd79-eecf-482d-8d65-224587852aca" released by "delete_volume" :: held 0.850s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] Created reservations ['15ed2631-5ce0-4220-a5b3-ddf7401febf7', '64f4b48d-5479-4a8a-baae-bbdf83d2165e', '1e13c1c1-f8e3-42b1-806f-934e98a3ba78', '30e85485-d2fa-4ad9-94f3-fd9af5e19797'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:33 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:29:33 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] Acquiring lock "cinder-e0ed0b37-dfc0-4a71-9783-03711387909f-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] Lock "cinder-e0ed0b37-dfc0-4a71-9783-03711387909f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] Acquiring lock "cinder-quobyte-e0ed0b37-dfc0-4a71-9783-03711387909f" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] Lock "cinder-quobyte-e0ed0b37-dfc0-4a71-9783-03711387909f" acquired by "delete_volume" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df35f53-a536-4e8b-98dc-1fa459a9d2aa]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0ed0b37-dfc0-4a71-9783-03711387909f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:33 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.442s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:33 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:29:33 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] Deleted volume successfully. Sep 10 18:29:34 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0ed0b37-dfc0-4a71-9783-03711387909f Sep 10 18:29:34 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c6450bf7-e50f-46ba-a880-4effb7615b9f tempest-VolumesListTestJSON-319064748 None] Lock "cinder-ebdffd79-eecf-482d-8d65-224587852aca-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:34 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0ed0b37-dfc0-4a71-9783-03711387909f" returned: 0 in 0.593s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0ed0b37-dfc0-4a71-9783-03711387909f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:34 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0ed0b37-dfc0-4a71-9783-03711387909f Sep 10 18:29:34 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:34 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e0ed0b37-dfc0-4a71-9783-03711387909f" returned: 0 in 0.311s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] Lock "cinder-quobyte-e0ed0b37-dfc0-4a71-9783-03711387909f" released by "delete_volume" :: held 0.966s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:34 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] Created reservations ['65d7cf17-c862-426a-811d-21e67490c908', '027643b4-0b73-43a3-af7f-f1987e048d21', 'aa6c00c0-7736-4a85-a960-cf537bc84dfc', 'baa3bb04-6886-4509-92b3-e81792510d3f'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:29:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:29:35 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:29:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:35 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:29:35 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:35 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.338s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:35 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:29:35 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] Deleted volume successfully. Sep 10 18:29:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-78913f12-f9a6-4d43-b30f-30a120a74a58 tempest-VolumesListTestJSON-319064748 None] Lock "cinder-e0ed0b37-dfc0-4a71-9783-03711387909f-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:37 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-a879fe82-66a5-489b-bccb-6a1f2b303d17 req-fb85a561-e0d7-4459-81f3-cbb5c25c1765 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Terminate volume connection completed successfully. Sep 10 18:29:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-a879fe82-66a5-489b-bccb-6a1f2b303d17 req-fb85a561-e0d7-4459-81f3-cbb5c25c1765 tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Deleting attachment d1aee15a-dcf0-4e5e-9cac-bd132d5b13c4. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:29:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Acquiring lock "cinder-c9736333-77b1-41fb-b486-ad46503d9fc2-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Lock "cinder-c9736333-77b1-41fb-b486-ad46503d9fc2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Acquiring lock "cinder-quobyte-c9736333-77b1-41fb-b486-ad46503d9fc2" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Lock "cinder-quobyte-c9736333-77b1-41fb-b486-ad46503d9fc2" acquired by "delete_volume" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:38 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97e4b0b-ddb9-42f3-8e82-2bc26152fe09]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c9736333-77b1-41fb-b486-ad46503d9fc2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:38 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c9736333-77b1-41fb-b486-ad46503d9fc2 Sep 10 18:29:38 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:38 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c9736333-77b1-41fb-b486-ad46503d9fc2" returned: 0 in 0.386s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c9736333-77b1-41fb-b486-ad46503d9fc2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:38 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c9736333-77b1-41fb-b486-ad46503d9fc2 Sep 10 18:29:38 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:39 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c9736333-77b1-41fb-b486-ad46503d9fc2" returned: 0 in 0.285s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:39 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Lock "cinder-quobyte-c9736333-77b1-41fb-b486-ad46503d9fc2" released by "delete_volume" :: held 0.723s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:39 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Created reservations ['503cc8fb-1872-4a26-b9ae-01e9d9db51a1', '03407470-2c9f-4d00-8f46-65cdd3cd549a', '156197d6-c35b-4fcb-a764-16175bca7805', '82e8825c-8588-4f81-a75a-04538493f607'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:29:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:39 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:29:39 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:29:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:39 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:29:39 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:39 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.337s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:39 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:29:39 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Deleted volume successfully. Sep 10 18:29:39 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-40505f6d-498e-4148-acab-375bebce811b tempest-TestServerVolumeAttachScenarioOldVersion-1851797309 None] Lock "cinder-c9736333-77b1-41fb-b486-ad46503d9fc2-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:29:49 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:UPDATE=36,cinder:SELECT=36,cinder:DELETE=2,cinder:INSERT=7 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:29:49 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=24,cinder:UPDATE=49,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Flow 'volume_create_manager' (0e66dea4-3c2c-479a-bc5f-fffa9fdf1c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ea0257-e107-4e4a-847b-b1f8a92fa462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ea0257-e107-4e4a-847b-b1f8a92fa462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1036119980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b835a269-5645-4e6a-9e83-1c43112f3d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117d4b72159847c6819cda36112942c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:29:53Z,use_quota=True,user_id='ae042bd113d64c2db8ff038922f51c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce7159e-3c32-4f32-b40d-2851c46ea026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce7159e-3c32-4f32-b40d-2851c46ea026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c5420f-0b2f-4967-a431-f48e95444d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c5420f-0b2f-4967-a431-f48e95444d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b835a269-5645-4e6a-9e83-1c43112f3d58', 'volume_name': 'volume-b835a269-5645-4e6a-9e83-1c43112f3d58', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781919c8-88b5-4964-bbeb-a5873bfca3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781919c8-88b5-4964-bbeb-a5873bfca3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ed92d6-7b81-40fa-9edb-f92fcfc3a5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:53 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Volume b835a269-5645-4e6a-9e83-1c43112f3d58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b835a269-5645-4e6a-9e83-1c43112f3d58', 'volume_size': 1} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1036119980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b835a269-5645-4e6a-9e83-1c43112f3d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117d4b72159847c6819cda36112942c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:29:53Z,use_quota=True,user_id='ae042bd113d64c2db8ff038922f51c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Creating volume b835a269-5645-4e6a-9e83-1c43112f3d58 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:29:53 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:29:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:53 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58 1073741824 Sep 10 18:29:53 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:54 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58 1073741824" returned: 0 in 0.575s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:54 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58 Sep 10 18:29:54 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:54 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58" returned: 0 in 0.335s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:29:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ed92d6-7b81-40fa-9edb-f92fcfc3a5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b835a269-5645-4e6a-9e83-1c43112f3d58', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba04d0dc-a62f-4314-b95c-637200bdc2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:29:54 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Volume volume-b835a269-5645-4e6a-9e83-1c43112f3d58 (b835a269-5645-4e6a-9e83-1c43112f3d58): created successfully Sep 10 18:29:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba04d0dc-a62f-4314-b95c-637200bdc2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:29:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Flow 'volume_create_manager' (0e66dea4-3c2c-479a-bc5f-fffa9fdf1c7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:29:54 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-b9faed86-f4bd-46c1-82bd-e6c7040f051c tempest-VolumesSnapshotTestJSON-1871364312 None] Created volume successfully. Sep 10 18:29:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d1278c54-4c85-4d86-b6da-a212bf45462b tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:29:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d1278c54-4c85-4d86-b6da-a212bf45462b tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:29:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-d1278c54-4c85-4d86-b6da-a212bf45462b tempest-VolumesSnapshotTestJSON-1871364312 None] Creating offline snapshot 0a7aaed6-6ff8-40a1-aa18-c4976a65afc4 of volume b835a269-5645-4e6a-9e83-1c43112f3d58 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:29:56 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec2914b-88ce-472c-8595-dd29157d7c84]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d1278c54-4c85-4d86-b6da-a212bf45462b tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:56 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58 Sep 10 18:29:56 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:56 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d1278c54-4c85-4d86-b6da-a212bf45462b tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58" returned: 0 in 0.497s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d1278c54-4c85-4d86-b6da-a212bf45462b tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:56 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4 1G Sep 10 18:29:56 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:57 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d1278c54-4c85-4d86-b6da-a212bf45462b tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4 1G" returned: 0 in 0.694s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d1278c54-4c85-4d86-b6da-a212bf45462b tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b835a269-5645-4e6a-9e83-1c43112f3d58 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:57 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b835a269-5645-4e6a-9e83-1c43112f3d58 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4 Sep 10 18:29:57 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:57 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d1278c54-4c85-4d86-b6da-a212bf45462b tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b835a269-5645-4e6a-9e83-1c43112f3d58 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4" returned: 0 in 0.417s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:57 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-d1278c54-4c85-4d86-b6da-a212bf45462b tempest-VolumesSnapshotTestJSON-1871364312 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4 is being set with open permissions: ugo+rw Sep 10 18:29:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d1278c54-4c85-4d86-b6da-a212bf45462b tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:57 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4 Sep 10 18:29:57 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:58 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d1278c54-4c85-4d86-b6da-a212bf45462b tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4" returned: 0 in 0.331s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d1278c54-4c85-4d86-b6da-a212bf45462b tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:58 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.info Sep 10 18:29:58 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:58 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d1278c54-4c85-4d86-b6da-a212bf45462b tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.info" returned: 0 in 0.364s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:58 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-d1278c54-4c85-4d86-b6da-a212bf45462b tempest-VolumesSnapshotTestJSON-1871364312 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.info is being set with open permissions: ugo+rw Sep 10 18:29:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d1278c54-4c85-4d86-b6da-a212bf45462b tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:58 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.info Sep 10 18:29:58 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:29:58 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Sep 10 18:29:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d1278c54-4c85-4d86-b6da-a212bf45462b tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.info" returned: 0 in 0.372s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:29:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d1278c54-4c85-4d86-b6da-a212bf45462b tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.821s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:29:59 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d1278c54-4c85-4d86-b6da-a212bf45462b tempest-VolumesSnapshotTestJSON-1871364312 None] Create snapshot completed successfully Sep 10 18:29:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-0a7aaed6-6ff8-40a1-aa18-c4976a65afc4-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-0a7aaed6-6ff8-40a1-aa18-c4976a65afc4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-quobyte-b835a269-5645-4e6a-9e83-1c43112f3d58" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-b835a269-5645-4e6a-9e83-1c43112f3d58" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-quobyte-0a7aaed6-6ff8-40a1-aa18-c4976a65afc4" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:29:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-0a7aaed6-6ff8-40a1-aa18-c4976a65afc4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:29:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] Deleting offline snapshot 0a7aaed6-6ff8-40a1-aa18-c4976a65afc4 of volume b835a269-5645-4e6a-9e83-1c43112f3d58 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:29:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] snapshot_file for this snap is: volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:29:59 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b72fa46-e88e-4bd4-be25-8e0673ac57ba]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:29:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:29:59 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4 Sep 10 18:29:59 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:00 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4" returned: 0 in 0.409s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:00 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b835a269-5645-4e6a-9e83-1c43112f3d58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:30:00 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ad934c-6ad2-4253-8ad8-799d3b9f410d]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:30:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:00 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58 Sep 10 18:30:00 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:00 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58" returned: 0 in 0.453s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:00 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4 Sep 10 18:30:00 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:01 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4" returned: 0 in 0.442s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:01 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4 Sep 10 18:30:01 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:01 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58.0a7aaed6-6ff8-40a1-aa18-c4976a65afc4" returned: 0 in 0.278s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-0a7aaed6-6ff8-40a1-aa18-c4976a65afc4" released by "_delete_snapshot" :: held 1.707s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-b835a269-5645-4e6a-9e83-1c43112f3d58" released by "delete_snapshot" :: held 1.741s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:01 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] Created reservations ['c1a3c3f1-9160-44e1-b2c8-55feb5e3564d', 'd0d06b55-ff49-40aa-9740-0c485040ee93', '52f64742-0513-459a-8ee8-647fd26912e9', '2d72290f-3951-4f27-a575-026c3a0e78de'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:30:01 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] Delete snapshot completed successfully. Sep 10 18:30:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3eadde5b-35fa-4f8f-b977-d47bf0b16207 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-0a7aaed6-6ff8-40a1-aa18-c4976a65afc4-delete_snapshot" released by "delete_snapshot" :: held 1.944s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Flow 'volume_create_manager' (21ca27eb-eb10-45ad-a4e9-a283983b17ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97262689-8253-45e6-ad7a-9e3014458d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97262689-8253-45e6-ad7a-9e3014458d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1396224291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d30550-d980-4e6f-a0e6-19aca9cce7be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117d4b72159847c6819cda36112942c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:30:02Z,use_quota=True,user_id='ae042bd113d64c2db8ff038922f51c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd50bcc3-1eb4-4288-9b60-53847764172b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd50bcc3-1eb4-4288-9b60-53847764172b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8135fa97-11b5-4114-95bb-00a260420bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8135fa97-11b5-4114-95bb-00a260420bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d30550-d980-4e6f-a0e6-19aca9cce7be', 'volume_name': 'volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64488ce7-a2be-482c-945b-5db8ebd2d0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64488ce7-a2be-482c-945b-5db8ebd2d0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51908ac-36e0-476a-8c85-f4cdba8b2608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:02 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Volume e9d30550-d980-4e6f-a0e6-19aca9cce7be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be', 'volume_size': 1} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1396224291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d30550-d980-4e6f-a0e6-19aca9cce7be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117d4b72159847c6819cda36112942c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:30:02Z,use_quota=True,user_id='ae042bd113d64c2db8ff038922f51c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Creating volume e9d30550-d980-4e6f-a0e6-19aca9cce7be {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:30:02 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:30:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:02 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be 1073741824 Sep 10 18:30:02 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:03 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be 1073741824" returned: 0 in 0.591s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:03 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be Sep 10 18:30:03 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:03 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be" returned: 0 in 0.310s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:30:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51908ac-36e0-476a-8c85-f4cdba8b2608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a78a6d3-2759-4036-a52d-d6fd94b930a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:03 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Volume volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be (e9d30550-d980-4e6f-a0e6-19aca9cce7be): created successfully Sep 10 18:30:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a78a6d3-2759-4036-a52d-d6fd94b930a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Flow 'volume_create_manager' (21ca27eb-eb10-45ad-a4e9-a283983b17ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:30:03 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-5563fd2a-1d14-42bf-a820-2a74c7803f79 tempest-VolumesSnapshotTestJSON-1871364312 None] Created volume successfully. Sep 10 18:30:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-86a6ce23-206c-4789-ab00-fae6a2ad7c3b tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-86a6ce23-206c-4789-ab00-fae6a2ad7c3b tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:04 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-86a6ce23-206c-4789-ab00-fae6a2ad7c3b tempest-VolumesSnapshotTestJSON-1871364312 None] Creating offline snapshot 4a9107e5-c8ad-4316-88be-a7c4444fae52 of volume e9d30550-d980-4e6f-a0e6-19aca9cce7be {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:30:05 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[220ef128-0af9-469a-8b89-c3d7c16adfc3]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:30:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-86a6ce23-206c-4789-ab00-fae6a2ad7c3b tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:05 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be Sep 10 18:30:05 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:05 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-86a6ce23-206c-4789-ab00-fae6a2ad7c3b tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be" returned: 0 in 0.648s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-86a6ce23-206c-4789-ab00-fae6a2ad7c3b tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:05 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52 1G Sep 10 18:30:05 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:06 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-86a6ce23-206c-4789-ab00-fae6a2ad7c3b tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52 1G" returned: 0 in 0.656s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-86a6ce23-206c-4789-ab00-fae6a2ad7c3b tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:06 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52 Sep 10 18:30:06 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:06 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-86a6ce23-206c-4789-ab00-fae6a2ad7c3b tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52" returned: 0 in 0.440s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:06 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-86a6ce23-206c-4789-ab00-fae6a2ad7c3b tempest-VolumesSnapshotTestJSON-1871364312 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52 is being set with open permissions: ugo+rw Sep 10 18:30:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-86a6ce23-206c-4789-ab00-fae6a2ad7c3b tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:06 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52 Sep 10 18:30:06 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:07 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-86a6ce23-206c-4789-ab00-fae6a2ad7c3b tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52" returned: 0 in 0.343s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-86a6ce23-206c-4789-ab00-fae6a2ad7c3b tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:07 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.info Sep 10 18:30:07 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:07 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-86a6ce23-206c-4789-ab00-fae6a2ad7c3b tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.info" returned: 0 in 0.387s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:07 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-86a6ce23-206c-4789-ab00-fae6a2ad7c3b tempest-VolumesSnapshotTestJSON-1871364312 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.info is being set with open permissions: ugo+rw Sep 10 18:30:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-86a6ce23-206c-4789-ab00-fae6a2ad7c3b tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:07 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.info Sep 10 18:30:07 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:07 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-86a6ce23-206c-4789-ab00-fae6a2ad7c3b tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.info" returned: 0 in 0.278s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-86a6ce23-206c-4789-ab00-fae6a2ad7c3b tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.903s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:07 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-86a6ce23-206c-4789-ab00-fae6a2ad7c3b tempest-VolumesSnapshotTestJSON-1871364312 None] Create snapshot completed successfully Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Flow 'volume_create_manager' (b72aa465-545a-428f-a395-d5ede4d30f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd7a4b0-6a8f-44bd-9c34-0590a6e18e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd7a4b0-6a8f-44bd-9c34-0590a6e18e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-691712910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00203252-9d52-4344-9d14-eadb5357e93e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117d4b72159847c6819cda36112942c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:30:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=4a9107e5-c8ad-4316-88be-a7c4444fae52,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:30:09Z,use_quota=True,user_id='ae042bd113d64c2db8ff038922f51c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9d8ffd-611d-4da4-ab7b-1c12d6538831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9d8ffd-611d-4da4-ab7b-1c12d6538831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b604dd-96bf-4961-9f82-36193c27fd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b604dd-96bf-4961-9f82-36193c27fd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '00203252-9d52-4344-9d14-eadb5357e93e', 'volume_name': 'volume-00203252-9d52-4344-9d14-eadb5357e93e', 'volume_size': 2, 'snapshot_id': '4a9107e5-c8ad-4316-88be-a7c4444fae52'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81058e9d-32ca-4640-b1e6-60e5d046f3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81058e9d-32ca-4640-b1e6-60e5d046f3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57cd9fa4-be3d-4059-8898-6bb0264555ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:08 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Volume 00203252-9d52-4344-9d14-eadb5357e93e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-00203252-9d52-4344-9d14-eadb5357e93e', 'volume_size': 2, 'snapshot_id': '4a9107e5-c8ad-4316-88be-a7c4444fae52'} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-quobyte-4a9107e5-c8ad-4316-88be-a7c4444fae52-00203252-9d52-4344-9d14-eadb5357e93e" by "_create_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-4a9107e5-c8ad-4316-88be-a7c4444fae52-00203252-9d52-4344-9d14-eadb5357e93e" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Creating volume 00203252-9d52-4344-9d14-eadb5357e93e from snapshot 4a9107e5-c8ad-4316-88be-a7c4444fae52 {{(pid=87842) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:30:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-quobyte-00203252-9d52-4344-9d14-eadb5357e93e" by "_copy_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-00203252-9d52-4344-9d14-eadb5357e93e" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] snapshot: 4a9107e5-c8ad-4316-88be-a7c4444fae52, volume: 00203252-9d52-4344-9d14-eadb5357e93e, {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 18:30:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:09 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a7e69d-2eea-41ca-b88f-b9a5484e6fb6]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:30:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:09 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52 Sep 10 18:30:09 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:09 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52" returned: 0 in 0.453s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:30:09 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b703a8-02d8-4147-84ae-2ded417501cf]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:30:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:09 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be Sep 10 18:30:09 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:10 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be" returned: 0 in 0.490s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 18:30:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Creating direct copy from snapshot {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 18:30:10 devstack cinder-volume[87842]: DEBUG cinder.utils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Path /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-00203252-9d52-4344-9d14-eadb5357e93e not found in is_blk_device check {{(pid=87842) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 18:30:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-00203252-9d52-4344-9d14-eadb5357e93e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:10 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-00203252-9d52-4344-9d14-eadb5357e93e Sep 10 18:30:10 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:13 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:30:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Flow 'volume_create_manager' (3fd8a559-eed4-43c2-a4b1-980a8bdd3d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:30:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8732ce06-c37d-4a8c-ba14-aa97d7e10f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8732ce06-c37d-4a8c-ba14-aa97d7e10f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-984148892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5405ed73-5ba8-479d-bdaa-74eea697422f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edcb0f488b614068b364c08952e12db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:30:13Z,use_quota=True,user_id='c24908d8acef4f0cac469f6b7e5267ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60873c3b-97dd-440c-b4b8-5f1ed6c4a1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60873c3b-97dd-440c-b4b8-5f1ed6c4a1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d16681-06b8-4c42-a11d-532653f8b678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d16681-06b8-4c42-a11d-532653f8b678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5405ed73-5ba8-479d-bdaa-74eea697422f', 'volume_name': 'volume-5405ed73-5ba8-479d-bdaa-74eea697422f', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838a21ae-7c55-4393-8f13-186db9a1b56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838a21ae-7c55-4393-8f13-186db9a1b56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89078f17-3c33-40d0-8476-cc3a0cd47bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:13 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Volume 5405ed73-5ba8-479d-bdaa-74eea697422f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5405ed73-5ba8-479d-bdaa-74eea697422f', 'volume_size': 1} Sep 10 18:30:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:15 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-00203252-9d52-4344-9d14-eadb5357e93e" returned: 0 in 5.637s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:15 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Image conversion details: src /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-00203252-9d52-4344-9d14-eadb5357e93e {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:30:15 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Converted 1024.00 MB image at 181.60 MB/s Sep 10 18:30:15 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-00203252-9d52-4344-9d14-eadb5357e93e is being set with open permissions: ugo+rw Sep 10 18:30:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-00203252-9d52-4344-9d14-eadb5357e93e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:15 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-00203252-9d52-4344-9d14-eadb5357e93e Sep 10 18:30:15 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:16 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-00203252-9d52-4344-9d14-eadb5357e93e" returned: 0 in 0.263s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-00203252-9d52-4344-9d14-eadb5357e93e" released by "_copy_volume_from_snapshot" :: held 7.004s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-4a9107e5-c8ad-4316-88be-a7c4444fae52-00203252-9d52-4344-9d14-eadb5357e93e" released by "_create_volume_from_snapshot" :: held 7.097s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.124s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.573s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-984148892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5405ed73-5ba8-479d-bdaa-74eea697422f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edcb0f488b614068b364c08952e12db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:30:13Z,use_quota=True,user_id='c24908d8acef4f0cac469f6b7e5267ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Creating volume 5405ed73-5ba8-479d-bdaa-74eea697422f {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:30:16 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5405ed73-5ba8-479d-bdaa-74eea697422f 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:16 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5405ed73-5ba8-479d-bdaa-74eea697422f 1073741824 Sep 10 18:30:16 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57cd9fa4-be3d-4059-8898-6bb0264555ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00203252-9d52-4344-9d14-eadb5357e93e', 'volume_size': 2, 'snapshot_id': '4a9107e5-c8ad-4316-88be-a7c4444fae52'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324c3967-5cf5-450b-8525-b88412e37eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:16 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Volume volume-00203252-9d52-4344-9d14-eadb5357e93e (00203252-9d52-4344-9d14-eadb5357e93e): created successfully Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324c3967-5cf5-450b-8525-b88412e37eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Flow 'volume_create_manager' (b72aa465-545a-428f-a395-d5ede4d30f8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:30:16 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-170141c5-321a-48d0-bfa2-366204ca5712 tempest-VolumesSnapshotTestJSON-1871364312 None] Created volume successfully. Sep 10 18:30:16 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5405ed73-5ba8-479d-bdaa-74eea697422f 1073741824" returned: 0 in 0.630s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5405ed73-5ba8-479d-bdaa-74eea697422f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:16 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5405ed73-5ba8-479d-bdaa-74eea697422f Sep 10 18:30:16 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-00203252-9d52-4344-9d14-eadb5357e93e-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-00203252-9d52-4344-9d14-eadb5357e93e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-quobyte-00203252-9d52-4344-9d14-eadb5357e93e" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:17 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-00203252-9d52-4344-9d14-eadb5357e93e" acquired by "delete_volume" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5405ed73-5ba8-479d-bdaa-74eea697422f" returned: 0 in 0.346s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:30:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89078f17-3c33-40d0-8476-cc3a0cd47bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5405ed73-5ba8-479d-bdaa-74eea697422f', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34176f94-1187-4e6e-a91c-33265fb2b32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:17 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c97135-d86b-4714-9256-5eefd13da9db]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:30:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-00203252-9d52-4344-9d14-eadb5357e93e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:17 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Volume volume-5405ed73-5ba8-479d-bdaa-74eea697422f (5405ed73-5ba8-479d-bdaa-74eea697422f): created successfully Sep 10 18:30:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34176f94-1187-4e6e-a91c-33265fb2b32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Flow 'volume_create_manager' (3fd8a559-eed4-43c2-a4b1-980a8bdd3d98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:30:17 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-55e002e3-878e-4544-8a25-b61e477efa0d tempest-VolumesTransfersV357Test-1619633297 None] Created volume successfully. Sep 10 18:30:17 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-00203252-9d52-4344-9d14-eadb5357e93e Sep 10 18:30:17 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:17 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-00203252-9d52-4344-9d14-eadb5357e93e" returned: 0 in 0.454s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-00203252-9d52-4344-9d14-eadb5357e93e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:17 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-00203252-9d52-4344-9d14-eadb5357e93e Sep 10 18:30:17 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:17 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-00203252-9d52-4344-9d14-eadb5357e93e" returned: 0 in 0.295s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-00203252-9d52-4344-9d14-eadb5357e93e" released by "delete_volume" :: held 0.817s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:17 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] Created reservations ['b1623c59-8651-4efe-a80b-fc09e44e5eb6', '505efe43-dc78-4660-b6ee-bbe0c401d821', 'f2c6b32a-dd7d-4049-8c29-13cded6f1c0c', '7949dcfd-8fb7-442c-883a-ef0d3c2da4ce'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:30:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:18 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:30:18 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-4a9107e5-c8ad-4316-88be-a7c4444fae52-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-4a9107e5-c8ad-4316-88be-a7c4444fae52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:18 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-quobyte-e9d30550-d980-4e6f-a0e6-19aca9cce7be" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.331s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:18 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:30:18 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] Deleted volume successfully. Sep 10 18:30:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-e9d30550-d980-4e6f-a0e6-19aca9cce7be" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-quobyte-4a9107e5-c8ad-4316-88be-a7c4444fae52" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-4a9107e5-c8ad-4316-88be-a7c4444fae52" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] Deleting offline snapshot 4a9107e5-c8ad-4316-88be-a7c4444fae52 of volume e9d30550-d980-4e6f-a0e6-19aca9cce7be {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:30:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] snapshot_file for this snap is: volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:30:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-729f9ca0-52fc-47d3-ba43-68519e73a244 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-00203252-9d52-4344-9d14-eadb5357e93e-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:18 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf4834e-fb8a-4c70-b5a8-68c829c92d3d]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:30:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:18 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52 Sep 10 18:30:18 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:19 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52" returned: 0 in 0.666s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:30:19 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d37ebe4-098c-45c8-ae6a-2e1f60b3d385]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:30:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:19 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be Sep 10 18:30:19 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:19 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4e25a8f6-5cdc-4db9-b19a-ff4bfbddb287 tempest-VolumesTransfersV357Test-1309885720 None] Transfer volume completed successfully. Sep 10 18:30:20 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be" returned: 0 in 0.833s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:20 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52 Sep 10 18:30:20 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] Acquiring lock "cinder-5405ed73-5ba8-479d-bdaa-74eea697422f-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] Lock "cinder-5405ed73-5ba8-479d-bdaa-74eea697422f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] Acquiring lock "cinder-quobyte-5405ed73-5ba8-479d-bdaa-74eea697422f" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] Lock "cinder-quobyte-5405ed73-5ba8-479d-bdaa-74eea697422f" acquired by "delete_volume" :: waited 0.013s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:20 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99eadfc-362a-4374-b61b-95ed552f3553]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:30:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5405ed73-5ba8-479d-bdaa-74eea697422f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:20 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52" returned: 0 in 0.577s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:20 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52 Sep 10 18:30:20 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:20 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5405ed73-5ba8-479d-bdaa-74eea697422f Sep 10 18:30:20 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:21 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be.4a9107e5-c8ad-4316-88be-a7c4444fae52" returned: 0 in 0.370s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:21 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5405ed73-5ba8-479d-bdaa-74eea697422f" returned: 0 in 0.514s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5405ed73-5ba8-479d-bdaa-74eea697422f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-4a9107e5-c8ad-4316-88be-a7c4444fae52" released by "_delete_snapshot" :: held 2.643s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-e9d30550-d980-4e6f-a0e6-19aca9cce7be" released by "delete_snapshot" :: held 2.705s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:21 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5405ed73-5ba8-479d-bdaa-74eea697422f Sep 10 18:30:21 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] Created reservations ['11f043e4-6911-4ab7-9d20-dbb925cf5d3b', '4f115ff6-aa24-4b46-bbe5-ba14aa728a09', '4680005a-a9ca-475b-946c-ebf72a9e704c', '8cd3cc8f-91f1-4fe3-83d7-16c9adcaf64f'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:30:21 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] Delete snapshot completed successfully. Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2896f8c4-4ba2-48e5-8e7b-17cdcf51de2d tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-4a9107e5-c8ad-4316-88be-a7c4444fae52-delete_snapshot" released by "delete_snapshot" :: held 2.940s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:21 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5405ed73-5ba8-479d-bdaa-74eea697422f" returned: 0 in 0.372s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] Lock "cinder-quobyte-5405ed73-5ba8-479d-bdaa-74eea697422f" released by "delete_volume" :: held 0.942s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] Created reservations ['7d7785de-f490-49f3-aaf4-0ce0aff9b154', '8f17413e-d17c-45b1-b855-c8ac639ea50d', '8413edc0-ef9a-4557-8916-2812016c60ac', '2cddae44-e0c7-410d-b0d8-30925a76904a'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-e9d30550-d980-4e6f-a0e6-19aca9cce7be-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-e9d30550-d980-4e6f-a0e6-19aca9cce7be-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:21 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:30:21 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-quobyte-e9d30550-d980-4e6f-a0e6-19aca9cce7be" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-e9d30550-d980-4e6f-a0e6-19aca9cce7be" acquired by "delete_volume" :: waited 0.020s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4c2a25-1dbe-41d2-bd4e-a14a88dc8eaa]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:30:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:22 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be Sep 10 18:30:22 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:22 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.395s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:22 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:30:22 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] Deleted volume successfully. Sep 10 18:30:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8223c9d0-46c1-4ad0-9be8-a3e29c834dbd tempest-VolumesTransfersV357Test-382320290 None] Lock "cinder-5405ed73-5ba8-479d-bdaa-74eea697422f-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:22 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be" returned: 0 in 0.456s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:22 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be Sep 10 18:30:22 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:22 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e9d30550-d980-4e6f-a0e6-19aca9cce7be" returned: 0 in 0.257s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-e9d30550-d980-4e6f-a0e6-19aca9cce7be" released by "delete_volume" :: held 0.809s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:22 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] Created reservations ['5d02a8d8-1baf-4f1a-bffa-3d14df958c4e', '53fdda3f-b023-4268-8355-561cfc3dbad3', '4d5a83ee-aa65-4565-896b-a61d3c7975ba', '07775b4b-3ee8-44c9-98ce-c74afba1b62a'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:30:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:22 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:30:22 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:23 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.579s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:30:23 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] Deleted volume successfully. Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5003633e-b556-482c-ae88-92bcfd2a247f tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-e9d30550-d980-4e6f-a0e6-19aca9cce7be-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Flow 'volume_create_manager' (e3bef2c1-2fd1-432d-98fa-c5ac9e9f636d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe39c67-8170-4a80-9a39-356a2c1de87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe39c67-8170-4a80-9a39-356a2c1de87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1463938904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7f9423-e467-437d-97b9-372d96a02080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edcb0f488b614068b364c08952e12db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:30:24Z,use_quota=True,user_id='c24908d8acef4f0cac469f6b7e5267ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c81aa3-ef14-401e-bcdf-db86feece512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c81aa3-ef14-401e-bcdf-db86feece512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c692bed4-ee3d-4a94-b1ce-22db9034e823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c692bed4-ee3d-4a94-b1ce-22db9034e823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de7f9423-e467-437d-97b9-372d96a02080', 'volume_name': 'volume-de7f9423-e467-437d-97b9-372d96a02080', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b1e456-959e-49f7-8c2c-67b9b2ec824f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b1e456-959e-49f7-8c2c-67b9b2ec824f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc69d76a-c52a-49de-beea-c9932e052054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:23 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Volume de7f9423-e467-437d-97b9-372d96a02080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de7f9423-e467-437d-97b9-372d96a02080', 'volume_size': 1} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1463938904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7f9423-e467-437d-97b9-372d96a02080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edcb0f488b614068b364c08952e12db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:30:24Z,use_quota=True,user_id='c24908d8acef4f0cac469f6b7e5267ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Creating volume de7f9423-e467-437d-97b9-372d96a02080 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:30:23 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-de7f9423-e467-437d-97b9-372d96a02080 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:23 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-de7f9423-e467-437d-97b9-372d96a02080 1073741824 Sep 10 18:30:23 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Flow 'volume_create_manager' (0b775782-8d69-41fb-9c9d-34455aa6168c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d90ec2-fbab-4622-8d24-dae59c522600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d90ec2-fbab-4622-8d24-dae59c522600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-65678150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8adb09d8-0a3a-481f-89cf-8aacee974baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117d4b72159847c6819cda36112942c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:30:24Z,use_quota=True,user_id='ae042bd113d64c2db8ff038922f51c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467f5f96-ad76-4951-996b-d2b4ae246a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467f5f96-ad76-4951-996b-d2b4ae246a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741c2a5f-9086-459c-94ab-1889e5450b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741c2a5f-9086-459c-94ab-1889e5450b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8adb09d8-0a3a-481f-89cf-8aacee974baf', 'volume_name': 'volume-8adb09d8-0a3a-481f-89cf-8aacee974baf', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44a965d-6e61-4660-bbf0-d4563c89fd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44a965d-6e61-4660-bbf0-d4563c89fd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8ce5f8-63f2-40b3-b732-c2bef457ee0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:23 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Volume 8adb09d8-0a3a-481f-89cf-8aacee974baf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8adb09d8-0a3a-481f-89cf-8aacee974baf', 'volume_size': 1} Sep 10 18:30:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:24 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-de7f9423-e467-437d-97b9-372d96a02080 1073741824" returned: 0 in 0.634s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-de7f9423-e467-437d-97b9-372d96a02080 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:24 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-de7f9423-e467-437d-97b9-372d96a02080 Sep 10 18:30:24 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:24 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-de7f9423-e467-437d-97b9-372d96a02080" returned: 0 in 0.309s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:24 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:30:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.800s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:24 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-65678150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8adb09d8-0a3a-481f-89cf-8aacee974baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117d4b72159847c6819cda36112942c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:30:24Z,use_quota=True,user_id='ae042bd113d64c2db8ff038922f51c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:30:24 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Creating volume 8adb09d8-0a3a-481f-89cf-8aacee974baf {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:30:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:24 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:24 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:24 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:30:24 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:30:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:24 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf 1073741824 Sep 10 18:30:24 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc69d76a-c52a-49de-beea-c9932e052054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de7f9423-e467-437d-97b9-372d96a02080', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9638ae-3007-479b-be8b-83c17c534217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:24 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Volume volume-de7f9423-e467-437d-97b9-372d96a02080 (de7f9423-e467-437d-97b9-372d96a02080): created successfully Sep 10 18:30:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9638ae-3007-479b-be8b-83c17c534217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Flow 'volume_create_manager' (e3bef2c1-2fd1-432d-98fa-c5ac9e9f636d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:30:24 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4d3fe064-86b4-4871-8fc2-d1b43210756e tempest-VolumesTransfersV357Test-1619633297 None] Created volume successfully. Sep 10 18:30:25 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf 1073741824" returned: 0 in 0.496s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:25 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf Sep 10 18:30:25 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:25 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf" returned: 0 in 0.300s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:25 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:30:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:25 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8ce5f8-63f2-40b3-b732-c2bef457ee0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8adb09d8-0a3a-481f-89cf-8aacee974baf', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:25 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddaf9395-9733-4e7d-a745-c78e94b73c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:25 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Volume volume-8adb09d8-0a3a-481f-89cf-8aacee974baf (8adb09d8-0a3a-481f-89cf-8aacee974baf): created successfully Sep 10 18:30:25 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddaf9395-9733-4e7d-a745-c78e94b73c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:25 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Flow 'volume_create_manager' (0b775782-8d69-41fb-9c9d-34455aa6168c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:30:25 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c63f933d-e474-481e-8737-4b5f1511b2bf tempest-VolumesSnapshotTestJSON-1871364312 None] Created volume successfully. Sep 10 18:30:26 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] Acquiring lock "cinder-de7f9423-e467-437d-97b9-372d96a02080-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:26 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] Lock "cinder-de7f9423-e467-437d-97b9-372d96a02080-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:26 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] Acquiring lock "cinder-quobyte-de7f9423-e467-437d-97b9-372d96a02080" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:26 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] Lock "cinder-quobyte-de7f9423-e467-437d-97b9-372d96a02080" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:26 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5aaa32-c372-4a20-b87b-f4587627a596]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:30:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-de7f9423-e467-437d-97b9-372d96a02080 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c1242421-01ed-400f-afb3-6d9f0c3ca64f tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c1242421-01ed-400f-afb3-6d9f0c3ca64f tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:26 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c1242421-01ed-400f-afb3-6d9f0c3ca64f tempest-VolumesSnapshotTestJSON-1871364312 None] Creating offline snapshot d7ac6ced-0b09-4964-95e1-84e644cb2562 of volume 8adb09d8-0a3a-481f-89cf-8aacee974baf {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:30:26 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f00720a-cd66-43c0-880e-82c31d2f6df6]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:30:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c1242421-01ed-400f-afb3-6d9f0c3ca64f tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:26 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-de7f9423-e467-437d-97b9-372d96a02080 Sep 10 18:30:26 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:26 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf Sep 10 18:30:26 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:26 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-de7f9423-e467-437d-97b9-372d96a02080" returned: 0 in 0.531s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-de7f9423-e467-437d-97b9-372d96a02080 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:26 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-de7f9423-e467-437d-97b9-372d96a02080 Sep 10 18:30:26 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:26 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c1242421-01ed-400f-afb3-6d9f0c3ca64f tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf" returned: 0 in 0.481s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c1242421-01ed-400f-afb3-6d9f0c3ca64f tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:26 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562 1G Sep 10 18:30:26 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:27 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-de7f9423-e467-437d-97b9-372d96a02080" returned: 0 in 0.360s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] Lock "cinder-quobyte-de7f9423-e467-437d-97b9-372d96a02080" released by "delete_volume" :: held 0.956s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:27 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] Created reservations ['e257ded5-faca-4f2a-8223-3bee720c8941', '145170af-0aff-4f24-a2ab-1dfbaf0336b6', '9c190060-c865-489f-9aee-a0e599b0dd01', 'ba1fa3b7-5d3a-431b-b0c3-95328608cdbc'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:30:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:27 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:30:27 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:27 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c1242421-01ed-400f-afb3-6d9f0c3ca64f tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562 1G" returned: 0 in 0.648s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c1242421-01ed-400f-afb3-6d9f0c3ca64f tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8adb09d8-0a3a-481f-89cf-8aacee974baf -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:27 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8adb09d8-0a3a-481f-89cf-8aacee974baf -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562 Sep 10 18:30:27 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:27 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.360s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:27 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:30:27 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] Deleted volume successfully. Sep 10 18:30:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-20204a6d-1b25-4173-b0d7-e211e18afc45 tempest-VolumesTransfersV357Test-382320290 None] Lock "cinder-de7f9423-e467-437d-97b9-372d96a02080-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:27 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c1242421-01ed-400f-afb3-6d9f0c3ca64f tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8adb09d8-0a3a-481f-89cf-8aacee974baf -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562" returned: 0 in 0.408s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:27 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-c1242421-01ed-400f-afb3-6d9f0c3ca64f tempest-VolumesSnapshotTestJSON-1871364312 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562 is being set with open permissions: ugo+rw Sep 10 18:30:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c1242421-01ed-400f-afb3-6d9f0c3ca64f tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:27 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562 Sep 10 18:30:27 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:28 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c1242421-01ed-400f-afb3-6d9f0c3ca64f tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562" returned: 0 in 0.296s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c1242421-01ed-400f-afb3-6d9f0c3ca64f tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:28 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.info Sep 10 18:30:28 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:28 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c1242421-01ed-400f-afb3-6d9f0c3ca64f tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.info" returned: 0 in 0.386s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:28 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-c1242421-01ed-400f-afb3-6d9f0c3ca64f tempest-VolumesSnapshotTestJSON-1871364312 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.info is being set with open permissions: ugo+rw Sep 10 18:30:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c1242421-01ed-400f-afb3-6d9f0c3ca64f tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:28 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.info Sep 10 18:30:28 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:30:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:29 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c1242421-01ed-400f-afb3-6d9f0c3ca64f tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.info" returned: 0 in 0.414s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:29 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:30:29 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c1242421-01ed-400f-afb3-6d9f0c3ca64f tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.791s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:29 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c1242421-01ed-400f-afb3-6d9f0c3ca64f tempest-VolumesSnapshotTestJSON-1871364312 None] Create snapshot completed successfully Sep 10 18:30:29 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.439s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:30:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:30:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 28 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:30:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Flow 'volume_create_manager' (3e5e9507-7ee2-4de8-97cc-c1a9ce41ef29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aaf6d0a-5873-494c-80b5-ce6aa262ee29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aaf6d0a-5873-494c-80b5-ce6aa262ee29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1584755110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=189d9193-3aef-4ac5-814c-b3c1d91d359d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117d4b72159847c6819cda36112942c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d7ac6ced-0b09-4964-95e1-84e644cb2562,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:30:30Z,use_quota=True,user_id='ae042bd113d64c2db8ff038922f51c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbb6977-8836-4aa4-98e6-579177fbf450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbb6977-8836-4aa4-98e6-579177fbf450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c7c4df-1d08-4ecf-bb73-ef5428f9f05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c7c4df-1d08-4ecf-bb73-ef5428f9f05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '189d9193-3aef-4ac5-814c-b3c1d91d359d', 'volume_name': 'volume-189d9193-3aef-4ac5-814c-b3c1d91d359d', 'volume_size': 1, 'snapshot_id': 'd7ac6ced-0b09-4964-95e1-84e644cb2562'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f365ec-773b-4d28-b8d6-da770b42f40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f365ec-773b-4d28-b8d6-da770b42f40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b962f316-525c-4f6a-950c-7f1db2bf41df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:30 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Volume 189d9193-3aef-4ac5-814c-b3c1d91d359d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-189d9193-3aef-4ac5-814c-b3c1d91d359d', 'volume_size': 1, 'snapshot_id': 'd7ac6ced-0b09-4964-95e1-84e644cb2562'} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-quobyte-d7ac6ced-0b09-4964-95e1-84e644cb2562-189d9193-3aef-4ac5-814c-b3c1d91d359d" by "_create_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-d7ac6ced-0b09-4964-95e1-84e644cb2562-189d9193-3aef-4ac5-814c-b3c1d91d359d" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Creating volume 189d9193-3aef-4ac5-814c-b3c1d91d359d from snapshot d7ac6ced-0b09-4964-95e1-84e644cb2562 {{(pid=87842) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-quobyte-189d9193-3aef-4ac5-814c-b3c1d91d359d" by "_copy_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-189d9193-3aef-4ac5-814c-b3c1d91d359d" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] snapshot: d7ac6ced-0b09-4964-95e1-84e644cb2562, volume: 189d9193-3aef-4ac5-814c-b3c1d91d359d, {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab605367-2aae-48c7-baf0-1cdb1b6af71e]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:30:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:30 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562 Sep 10 18:30:30 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:31 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562" returned: 0 in 0.568s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:31 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8adb09d8-0a3a-481f-89cf-8aacee974baf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:30:31 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7229fd9a-3790-4220-82fb-88debdeac0d9]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:30:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:31 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf Sep 10 18:30:31 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:31 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf" returned: 0 in 0.383s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:31 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 18:30:31 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Creating direct copy from snapshot {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 18:30:31 devstack cinder-volume[87842]: DEBUG cinder.utils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Path /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-189d9193-3aef-4ac5-814c-b3c1d91d359d not found in is_blk_device check {{(pid=87842) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 18:30:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-189d9193-3aef-4ac5-814c-b3c1d91d359d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:31 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-189d9193-3aef-4ac5-814c-b3c1d91d359d Sep 10 18:30:31 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:37 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-189d9193-3aef-4ac5-814c-b3c1d91d359d" returned: 0 in 6.035s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:37 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Image conversion details: src /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-189d9193-3aef-4ac5-814c-b3c1d91d359d {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:30:37 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Converted 1024.00 MB image at 169.64 MB/s Sep 10 18:30:37 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-189d9193-3aef-4ac5-814c-b3c1d91d359d is being set with open permissions: ugo+rw Sep 10 18:30:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-189d9193-3aef-4ac5-814c-b3c1d91d359d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:37 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-189d9193-3aef-4ac5-814c-b3c1d91d359d Sep 10 18:30:37 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:38 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-189d9193-3aef-4ac5-814c-b3c1d91d359d" returned: 0 in 0.285s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-189d9193-3aef-4ac5-814c-b3c1d91d359d" released by "_copy_volume_from_snapshot" :: held 7.372s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-d7ac6ced-0b09-4964-95e1-84e644cb2562-189d9193-3aef-4ac5-814c-b3c1d91d359d" released by "_create_volume_from_snapshot" :: held 7.445s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.465s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b962f316-525c-4f6a-950c-7f1db2bf41df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-189d9193-3aef-4ac5-814c-b3c1d91d359d', 'volume_size': 1, 'snapshot_id': 'd7ac6ced-0b09-4964-95e1-84e644cb2562'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca407a94-b2af-4cdc-908f-16fc5d3b88f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:38 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Volume volume-189d9193-3aef-4ac5-814c-b3c1d91d359d (189d9193-3aef-4ac5-814c-b3c1d91d359d): created successfully Sep 10 18:30:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca407a94-b2af-4cdc-908f-16fc5d3b88f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Flow 'volume_create_manager' (3e5e9507-7ee2-4de8-97cc-c1a9ce41ef29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:30:38 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-43f6b75e-196d-4d43-90f8-e4c0f53a0432 tempest-VolumesSnapshotTestJSON-1871364312 None] Created volume successfully. Sep 10 18:30:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-189d9193-3aef-4ac5-814c-b3c1d91d359d-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-189d9193-3aef-4ac5-814c-b3c1d91d359d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-quobyte-189d9193-3aef-4ac5-814c-b3c1d91d359d" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:38 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-189d9193-3aef-4ac5-814c-b3c1d91d359d" acquired by "delete_volume" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:38 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c69155e-aec2-47ba-9387-f103b6ad4c37]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:30:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-189d9193-3aef-4ac5-814c-b3c1d91d359d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:38 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-189d9193-3aef-4ac5-814c-b3c1d91d359d Sep 10 18:30:39 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:39 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-189d9193-3aef-4ac5-814c-b3c1d91d359d" returned: 0 in 0.479s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-189d9193-3aef-4ac5-814c-b3c1d91d359d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:39 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-189d9193-3aef-4ac5-814c-b3c1d91d359d Sep 10 18:30:39 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:39 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-189d9193-3aef-4ac5-814c-b3c1d91d359d" returned: 0 in 0.329s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:39 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-189d9193-3aef-4ac5-814c-b3c1d91d359d" released by "delete_volume" :: held 0.868s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:39 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] Created reservations ['ad19417e-bf1e-4e54-975c-fa86038b9d25', '13ede24b-cda8-408b-bb7f-db6d12453359', '9e5fddf6-292d-48f5-8bf9-3efde584ee2d', '781d7ba2-e3d2-4a47-99bf-425b2ceb538f'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:30:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:39 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:39 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:40 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:30:40 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-d7ac6ced-0b09-4964-95e1-84e644cb2562-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-d7ac6ced-0b09-4964-95e1-84e644cb2562-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-quobyte-8adb09d8-0a3a-481f-89cf-8aacee974baf" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-8adb09d8-0a3a-481f-89cf-8aacee974baf" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-quobyte-d7ac6ced-0b09-4964-95e1-84e644cb2562" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-d7ac6ced-0b09-4964-95e1-84e644cb2562" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:40 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] Deleting offline snapshot d7ac6ced-0b09-4964-95e1-84e644cb2562 of volume 8adb09d8-0a3a-481f-89cf-8aacee974baf {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:30:40 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] snapshot_file for this snap is: volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:30:40 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b061b713-b0d9-4dfc-ad1b-ba03a144e6d2]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:30:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:40 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.731s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:40 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:30:40 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] Deleted volume successfully. Sep 10 18:30:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-74045cb5-58a5-447d-aec2-6b5242de1d72 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-189d9193-3aef-4ac5-814c-b3c1d91d359d-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:40 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562 Sep 10 18:30:40 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:41 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562" returned: 0 in 0.768s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8adb09d8-0a3a-481f-89cf-8aacee974baf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[be871b71-6a74-4c30-b6ee-4a68a3409ed6]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:30:41 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf Sep 10 18:30:41 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Flow 'volume_create_manager' (99b67104-4255-42c6-8820-3097732a4784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22f2196-0d6e-43ed-95d6-cda1b95e408d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22f2196-0d6e-43ed-95d6-cda1b95e408d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1062481948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb3fc2a-ea43-4281-b1a3-7234f51922ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847b344f18e5404fb41f298dc6a7ba9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:30:42Z,use_quota=True,user_id='ae18300b923b408ea9323ebce89d7e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a1f21e-3d1f-49ad-8f2e-173e47d9a129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a1f21e-3d1f-49ad-8f2e-173e47d9a129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25964fb0-3816-4f99-b903-5a9fc02d3202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25964fb0-3816-4f99-b903-5a9fc02d3202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdb3fc2a-ea43-4281-b1a3-7234f51922ba', 'volume_name': 'volume-fdb3fc2a-ea43-4281-b1a3-7234f51922ba', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd58ef10-e456-4f15-acb1-d6377d121c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd58ef10-e456-4f15-acb1-d6377d121c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e78360-8aee-4f43-b443-d2564e6daa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:41 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Volume fdb3fc2a-ea43-4281-b1a3-7234f51922ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdb3fc2a-ea43-4281-b1a3-7234f51922ba', 'volume_size': 1} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1062481948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb3fc2a-ea43-4281-b1a3-7234f51922ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847b344f18e5404fb41f298dc6a7ba9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:30:42Z,use_quota=True,user_id='ae18300b923b408ea9323ebce89d7e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Creating volume fdb3fc2a-ea43-4281-b1a3-7234f51922ba {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:30:42 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:30:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fdb3fc2a-ea43-4281-b1a3-7234f51922ba 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:42 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fdb3fc2a-ea43-4281-b1a3-7234f51922ba 1073741824 Sep 10 18:30:42 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:42 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:42 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf" returned: 0 in 1.614s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fdb3fc2a-ea43-4281-b1a3-7234f51922ba 1073741824" returned: 0 in 1.026s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:43 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562 Sep 10 18:30:43 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fdb3fc2a-ea43-4281-b1a3-7234f51922ba {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:30:43 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fdb3fc2a-ea43-4281-b1a3-7234f51922ba Sep 10 18:30:43 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Flow 'volume_create_manager' (a92edaa5-13ac-42b9-8fce-0e1fbb4f4f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dced107-c39d-4659-b17f-9908ffbd088d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dced107-c39d-4659-b17f-9908ffbd088d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-578613796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51cd6a82-d77e-471a-bb90-4f94d0ef9ecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847b344f18e5404fb41f298dc6a7ba9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:30:43Z,use_quota=True,user_id='ae18300b923b408ea9323ebce89d7e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4b00e2-70e2-417d-b9b2-a771fc2735de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4b00e2-70e2-417d-b9b2-a771fc2735de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542d92d3-e625-43a8-8fd6-d3d28aae6a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542d92d3-e625-43a8-8fd6-d3d28aae6a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51cd6a82-d77e-471a-bb90-4f94d0ef9ecd', 'volume_name': 'volume-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7d4d2f-2540-41a1-b1aa-c23326f70b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7d4d2f-2540-41a1-b1aa-c23326f70b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ef309f-d9ee-430e-a280-ec59bce900ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:43 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Volume 51cd6a82-d77e-471a-bb90-4f94d0ef9ecd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd', 'volume_size': 1} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:43 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fdb3fc2a-ea43-4281-b1a3-7234f51922ba" returned: 0 in 0.390s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.115s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-578613796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51cd6a82-d77e-471a-bb90-4f94d0ef9ecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847b344f18e5404fb41f298dc6a7ba9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:30:43Z,use_quota=True,user_id='ae18300b923b408ea9323ebce89d7e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Creating volume 51cd6a82-d77e-471a-bb90-4f94d0ef9ecd {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:30:43 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e78360-8aee-4f43-b443-d2564e6daa76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdb3fc2a-ea43-4281-b1a3-7234f51922ba', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:43 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd 1073741824 Sep 10 18:30:43 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfcb1f4-1a00-44de-8451-5f7e46193c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:43 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Volume volume-fdb3fc2a-ea43-4281-b1a3-7234f51922ba (fdb3fc2a-ea43-4281-b1a3-7234f51922ba): created successfully Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfcb1f4-1a00-44de-8451-5f7e46193c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Flow 'volume_create_manager' (99b67104-4255-42c6-8820-3097732a4784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:30:43 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-028d1f35-ffb2-420c-80d8-7d48bfd813f2 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Created volume successfully. Sep 10 18:30:43 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562" returned: 0 in 0.944s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:44 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562 Sep 10 18:30:44 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:44 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf.d7ac6ced-0b09-4964-95e1-84e644cb2562" returned: 0 in 0.584s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:44 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-d7ac6ced-0b09-4964-95e1-84e644cb2562" released by "_delete_snapshot" :: held 4.238s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:44 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-8adb09d8-0a3a-481f-89cf-8aacee974baf" released by "delete_snapshot" :: held 4.287s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:44 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd 1073741824" returned: 0 in 1.121s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:44 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] Created reservations ['f1b30a1a-6bec-4e09-8b36-5436ddd465f2', '9948c292-bf1d-431e-a4f4-fd9c4d9d7ab9', '834905f3-a4a2-483b-834e-43130b400553', '58aedcee-4ece-4999-a779-297598f0df1d'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:30:44 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd Sep 10 18:30:44 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:45 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] Delete snapshot completed successfully. Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9eecbc70-ce05-4711-97f9-504c5d121695 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-d7ac6ced-0b09-4964-95e1-84e644cb2562-delete_snapshot" released by "delete_snapshot" :: held 4.942s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:45 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd" returned: 0 in 0.539s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ef309f-d9ee-430e-a280-ec59bce900ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2047b6d-0db3-46b5-92d5-55c3106c0a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:45 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Volume volume-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd (51cd6a82-d77e-471a-bb90-4f94d0ef9ecd): created successfully Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2047b6d-0db3-46b5-92d5-55c3106c0a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Flow 'volume_create_manager' (a92edaa5-13ac-42b9-8fce-0e1fbb4f4f16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:30:45 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-a9294f9c-6a02-4ac9-99e8-32378e75e42c tempest-TestServerVolumeAttachmentScenario-1688598671 None] Created volume successfully. Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Flow 'volume_create_manager' (8099877e-bbac-48ec-be8e-527f6db89759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640181fe-58e4-481d-a865-4bc6a33282b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640181fe-58e4-481d-a865-4bc6a33282b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-292081053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190c164b-92e4-4627-a980-49cd9b72ea70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ece4294d71459a91805e8024c8177d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:30:45Z,use_quota=True,user_id='df01517f405e4906b3cea6e4ab69da0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9d0e40-5596-4f1c-a5aa-2b1730d6a108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9d0e40-5596-4f1c-a5aa-2b1730d6a108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329c7b03-d056-4088-a6fb-15305467629b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329c7b03-d056-4088-a6fb-15305467629b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '190c164b-92e4-4627-a980-49cd9b72ea70', 'volume_name': 'volume-190c164b-92e4-4627-a980-49cd9b72ea70', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313e7676-d060-4450-b865-d1e85c881c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313e7676-d060-4450-b865-d1e85c881c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ecb280-822c-42a5-9815-ba2281346f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:45 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Volume 190c164b-92e4-4627-a980-49cd9b72ea70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-190c164b-92e4-4627-a980-49cd9b72ea70', 'volume_size': 1} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-292081053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190c164b-92e4-4627-a980-49cd9b72ea70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ece4294d71459a91805e8024c8177d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:30:45Z,use_quota=True,user_id='df01517f405e4906b3cea6e4ab69da0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Creating volume 190c164b-92e4-4627-a980-49cd9b72ea70 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:30:45 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-190c164b-92e4-4627-a980-49cd9b72ea70 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:45 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-190c164b-92e4-4627-a980-49cd9b72ea70 1073741824 Sep 10 18:30:45 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-8adb09d8-0a3a-481f-89cf-8aacee974baf-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:46 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-8adb09d8-0a3a-481f-89cf-8aacee974baf-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:46 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-quobyte-8adb09d8-0a3a-481f-89cf-8aacee974baf" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:46 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-8adb09d8-0a3a-481f-89cf-8aacee974baf" acquired by "delete_volume" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:46 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1315bf9b-84fc-454b-b59c-154a3aa64782]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:30:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:46 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf Sep 10 18:30:46 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:46 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-190c164b-92e4-4627-a980-49cd9b72ea70 1073741824" returned: 0 in 0.788s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-190c164b-92e4-4627-a980-49cd9b72ea70 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:46 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-190c164b-92e4-4627-a980-49cd9b72ea70 Sep 10 18:30:46 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:46 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf" returned: 0 in 0.563s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:46 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf Sep 10 18:30:46 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:46 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-190c164b-92e4-4627-a980-49cd9b72ea70" returned: 0 in 0.447s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:30:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ecb280-822c-42a5-9815-ba2281346f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-190c164b-92e4-4627-a980-49cd9b72ea70', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (931c6910-ce0b-4fd8-ad6c-c8641012a26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:30:46 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Volume volume-190c164b-92e4-4627-a980-49cd9b72ea70 (190c164b-92e4-4627-a980-49cd9b72ea70): created successfully Sep 10 18:30:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (931c6910-ce0b-4fd8-ad6c-c8641012a26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:30:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Flow 'volume_create_manager' (8099877e-bbac-48ec-be8e-527f6db89759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:30:46 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-9309d153-c3e6-43e6-ae38-6e9ff1ea9a99 tempest-VolumesActionsTest-310649298 None] Created volume successfully. Sep 10 18:30:47 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8adb09d8-0a3a-481f-89cf-8aacee974baf" returned: 0 in 0.381s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:47 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-8adb09d8-0a3a-481f-89cf-8aacee974baf" released by "delete_volume" :: held 1.022s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:47 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] Created reservations ['d3d0fe52-bdf6-442c-a6df-e45caf01a0d9', 'c1a57635-9523-40d1-be4f-bacd1a76c2b3', '7bc23c2e-fd98-4454-a64c-292ab9b363cc', 'b1ca01bd-55e8-4714-a2fc-04681bb2da99'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:30:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:47 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:30:47 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:47 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1dd087b8-d7be-4f4c-87dc-800965e9dfd2 tempest-VolumesActionsTest-310649298 None] Acquiring lock "cinder-190c164b-92e4-4627-a980-49cd9b72ea70" by "attach_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:47 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1dd087b8-d7be-4f4c-87dc-800965e9dfd2 tempest-VolumesActionsTest-310649298 None] Lock "cinder-190c164b-92e4-4627-a980-49cd9b72ea70" acquired by "attach_volume" :: waited 0.049s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:47 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-1dd087b8-d7be-4f4c-87dc-800965e9dfd2 tempest-VolumesActionsTest-310649298 None] Attaching volume 190c164b-92e4-4627-a980-49cd9b72ea70 to instance f6885482-d54f-4000-b480-6506c37ea59a at mountpoint /dev/vdb on host None. Sep 10 18:30:47 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-1dd087b8-d7be-4f4c-87dc-800965e9dfd2 tempest-VolumesActionsTest-310649298 None] Attach volume completed successfully. Sep 10 18:30:47 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1dd087b8-d7be-4f4c-87dc-800965e9dfd2 tempest-VolumesActionsTest-310649298 None] Lock "cinder-190c164b-92e4-4627-a980-49cd9b72ea70" released by "attach_volume" :: held 0.135s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:47 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.443s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:47 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:30:47 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] Deleted volume successfully. Sep 10 18:30:47 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-915ceb59-defd-46b6-9236-5a910507fc44 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-8adb09d8-0a3a-481f-89cf-8aacee974baf-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-b835a269-5645-4e6a-9e83-1c43112f3d58-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-b835a269-5645-4e6a-9e83-1c43112f3d58-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "cinder-quobyte-b835a269-5645-4e6a-9e83-1c43112f3d58" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-b835a269-5645-4e6a-9e83-1c43112f3d58" acquired by "delete_volume" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:48 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee1730a-507f-4713-baad-8e1a46e1fc33]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:30:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:48 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-299d7c89-2023-4376-9962-e11e2b569725 tempest-VolumesActionsTest-728127884 None] Terminate volume connection completed successfully. Sep 10 18:30:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-299d7c89-2023-4376-9962-e11e2b569725 tempest-VolumesActionsTest-728127884 None] Acquiring lock "cinder-190c164b-92e4-4627-a980-49cd9b72ea70-detach_volume" by "detach_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-299d7c89-2023-4376-9962-e11e2b569725 tempest-VolumesActionsTest-728127884 None] Lock "cinder-190c164b-92e4-4627-a980-49cd9b72ea70-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:48 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-299d7c89-2023-4376-9962-e11e2b569725 tempest-VolumesActionsTest-728127884 None] Detaching volume 190c164b-92e4-4627-a980-49cd9b72ea70 from instance f6885482-d54f-4000-b480-6506c37ea59a. Sep 10 18:30:48 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58 Sep 10 18:30:48 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:49 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-299d7c89-2023-4376-9962-e11e2b569725 tempest-VolumesActionsTest-728127884 None] Detach volume completed successfully. Sep 10 18:30:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-299d7c89-2023-4376-9962-e11e2b569725 tempest-VolumesActionsTest-728127884 None] Lock "cinder-190c164b-92e4-4627-a980-49cd9b72ea70-detach_volume" released by "detach_volume" :: held 0.209s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:49 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58" returned: 0 in 0.666s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:49 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58 Sep 10 18:30:49 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e74a6dbf-2d93-47e8-a177-ad8b0769b253 tempest-VolumesActionsTest-310649298 None] Acquiring lock "cinder-190c164b-92e4-4627-a980-49cd9b72ea70-detach_volume" by "detach_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e74a6dbf-2d93-47e8-a177-ad8b0769b253 tempest-VolumesActionsTest-310649298 None] Lock "cinder-190c164b-92e4-4627-a980-49cd9b72ea70-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:49 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e74a6dbf-2d93-47e8-a177-ad8b0769b253 tempest-VolumesActionsTest-310649298 None] Volume detach called, but volume not attached. Sep 10 18:30:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e74a6dbf-2d93-47e8-a177-ad8b0769b253 tempest-VolumesActionsTest-310649298 None] Lock "cinder-190c164b-92e4-4627-a980-49cd9b72ea70-detach_volume" released by "detach_volume" :: held 0.027s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] Acquiring lock "cinder-190c164b-92e4-4627-a980-49cd9b72ea70-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] Lock "cinder-190c164b-92e4-4627-a980-49cd9b72ea70-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:49 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=95,cinder:UPDATE=111,cinder:DELETE=10,cinder:INSERT=25 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:30:49 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:UPDATE=97,cinder:SELECT=96,cinder:INSERT=26,cinder:DELETE=9 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:30:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] Acquiring lock "cinder-quobyte-190c164b-92e4-4627-a980-49cd9b72ea70" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:30:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] Lock "cinder-quobyte-190c164b-92e4-4627-a980-49cd9b72ea70" acquired by "delete_volume" :: waited 0.045s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:30:50 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[573a9beb-80cc-4772-afd0-11e1eeb7b88e]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:30:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-190c164b-92e4-4627-a980-49cd9b72ea70 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:50 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b835a269-5645-4e6a-9e83-1c43112f3d58" returned: 0 in 0.697s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-quobyte-b835a269-5645-4e6a-9e83-1c43112f3d58" released by "delete_volume" :: held 1.487s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:50 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] Created reservations ['a8313257-8164-4f8b-bf72-e93d1c7f44e2', '45eb0dac-816f-4320-b734-fca92f1fcf46', '62c4918a-fe02-4323-9628-2881dc24f386', '5a492b67-ca45-4b32-bfdb-0466365cc2d4'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:30:50 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-190c164b-92e4-4627-a980-49cd9b72ea70 Sep 10 18:30:50 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:50 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:30:50 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:50 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.358s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:50 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:30:50 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-190c164b-92e4-4627-a980-49cd9b72ea70" returned: 0 in 0.705s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-190c164b-92e4-4627-a980-49cd9b72ea70 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:50 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] Deleted volume successfully. Sep 10 18:30:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d4c2429f-faa8-4ebb-934d-e858ef2aecf1 tempest-VolumesSnapshotTestJSON-1871364312 None] Lock "cinder-b835a269-5645-4e6a-9e83-1c43112f3d58-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:50 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-190c164b-92e4-4627-a980-49cd9b72ea70 Sep 10 18:30:50 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:51 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-190c164b-92e4-4627-a980-49cd9b72ea70" returned: 0 in 0.401s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] Lock "cinder-quobyte-190c164b-92e4-4627-a980-49cd9b72ea70" released by "delete_volume" :: held 1.200s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:30:51 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] Created reservations ['f790b875-9ebd-4ead-86be-55855a556bd2', '80bf920c-d50e-4124-b904-e5745eb2ddc8', '9182a009-8f59-4c27-b9ae-025b9eae1e52', '01919e49-9f3e-4317-87cd-78b218cdb5c7'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:30:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:30:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:30:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:30:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:30:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:30:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:30:51 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:30:51 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:30:51 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Sep 10 18:30:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.359s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:30:51 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:30:51 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] Deleted volume successfully. Sep 10 18:30:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-33ffea22-7f7e-4ece-ad49-edfa6be0153a tempest-VolumesActionsTest-310649298 None] Lock "cinder-190c164b-92e4-4627-a980-49cd9b72ea70-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Flow 'volume_create_manager' (bd4a1959-e077-4851-9cbb-f62a30775973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfc83cd-bbf8-4fdf-951e-74a5141bbf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfc83cd-bbf8-4fdf-951e-74a5141bbf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1536326365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d02698a-ab53-404d-9654-bd235f362e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ece4294d71459a91805e8024c8177d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:00Z,use_quota=True,user_id='df01517f405e4906b3cea6e4ab69da0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ef163f-32d3-471d-a3bb-afee5590508a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ef163f-32d3-471d-a3bb-afee5590508a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d38d228-5873-4444-85e8-67d34c8fc36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d38d228-5873-4444-85e8-67d34c8fc36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d02698a-ab53-404d-9654-bd235f362e8f', 'volume_name': 'volume-1d02698a-ab53-404d-9654-bd235f362e8f', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae574119-4718-4bf3-bab5-b4110c821f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae574119-4718-4bf3-bab5-b4110c821f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bb74cb-589c-4e15-8cc5-1feee51d9be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:00 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Volume 1d02698a-ab53-404d-9654-bd235f362e8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d02698a-ab53-404d-9654-bd235f362e8f', 'volume_size': 1} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1536326365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d02698a-ab53-404d-9654-bd235f362e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ece4294d71459a91805e8024c8177d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:00Z,use_quota=True,user_id='df01517f405e4906b3cea6e4ab69da0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Creating volume 1d02698a-ab53-404d-9654-bd235f362e8f {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:31:00 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:31:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d02698a-ab53-404d-9654-bd235f362e8f 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:00 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d02698a-ab53-404d-9654-bd235f362e8f 1073741824 Sep 10 18:31:00 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:01 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d02698a-ab53-404d-9654-bd235f362e8f 1073741824" returned: 0 in 0.894s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d02698a-ab53-404d-9654-bd235f362e8f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:01 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d02698a-ab53-404d-9654-bd235f362e8f Sep 10 18:31:01 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:02 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d02698a-ab53-404d-9654-bd235f362e8f" returned: 0 in 0.539s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:31:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bb74cb-589c-4e15-8cc5-1feee51d9be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d02698a-ab53-404d-9654-bd235f362e8f', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3279f055-d339-4995-bbe5-2b597bec3bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:02 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Volume volume-1d02698a-ab53-404d-9654-bd235f362e8f (1d02698a-ab53-404d-9654-bd235f362e8f): created successfully Sep 10 18:31:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3279f055-d339-4995-bbe5-2b597bec3bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Flow 'volume_create_manager' (bd4a1959-e077-4851-9cbb-f62a30775973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:02 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-09d0bbe0-9d99-46f9-b02a-bdffbfff0ed0 tempest-VolumesActionsTest-310649298 None] Created volume successfully. Sep 10 18:31:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] Acquiring lock "cinder-1d02698a-ab53-404d-9654-bd235f362e8f-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:02 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Flow 'volume_create_manager' (a1dfadcc-749f-486d-a130-3d5fd184c813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6b566c-84c6-4010-9fb5-684d1ff4a4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] Lock "cinder-1d02698a-ab53-404d-9654-bd235f362e8f-delete_volume" acquired by "delete_volume" :: waited 0.189s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6b566c-84c6-4010-9fb5-684d1ff4a4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-15893517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd8c07d-24e4-4114-be86-837e51ae7d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc382b836185497092de0de995c32642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:03Z,use_quota=True,user_id='347a299c9fde45229f9472ebcbe0733b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb589af-c71e-4cf7-922d-535ae8dac99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb589af-c71e-4cf7-922d-535ae8dac99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6c0301-697a-4b7a-958f-8b4d716df59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6c0301-697a-4b7a-958f-8b4d716df59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd8c07d-24e4-4114-be86-837e51ae7d83', 'volume_name': 'volume-ddd8c07d-24e4-4114-be86-837e51ae7d83', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93144ba0-08bf-4000-a682-9cfb2d786222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93144ba0-08bf-4000-a682-9cfb2d786222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbbfda7-57b2-4064-922c-c5e5ddd76711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:03 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Volume ddd8c07d-24e4-4114-be86-837e51ae7d83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd8c07d-24e4-4114-be86-837e51ae7d83', 'volume_size': 1} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-15893517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd8c07d-24e4-4114-be86-837e51ae7d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc382b836185497092de0de995c32642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:03Z,use_quota=True,user_id='347a299c9fde45229f9472ebcbe0733b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Creating volume ddd8c07d-24e4-4114-be86-837e51ae7d83 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:31:03 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:03 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 1073741824 Sep 10 18:31:03 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] Acquiring lock "cinder-quobyte-1d02698a-ab53-404d-9654-bd235f362e8f" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] Lock "cinder-quobyte-1d02698a-ab53-404d-9654-bd235f362e8f" acquired by "delete_volume" :: waited 0.028s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02985bc-0cd5-4417-81b2-605245ad5000]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d02698a-ab53-404d-9654-bd235f362e8f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:03 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d02698a-ab53-404d-9654-bd235f362e8f Sep 10 18:31:03 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:03 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 1073741824" returned: 0 in 0.633s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:04 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d02698a-ab53-404d-9654-bd235f362e8f" returned: 0 in 0.568s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d02698a-ab53-404d-9654-bd235f362e8f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:04 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 Sep 10 18:31:04 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:04 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d02698a-ab53-404d-9654-bd235f362e8f Sep 10 18:31:04 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:04 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1d02698a-ab53-404d-9654-bd235f362e8f" returned: 0 in 0.297s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] Lock "cinder-quobyte-1d02698a-ab53-404d-9654-bd235f362e8f" released by "delete_volume" :: held 0.967s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:04 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83" returned: 0 in 0.409s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:04 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:31:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:04 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbbfda7-57b2-4064-922c-c5e5ddd76711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd8c07d-24e4-4114-be86-837e51ae7d83', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:04 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92289a6-2e5f-447e-9334-322a8fff9bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:04 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Volume volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 (ddd8c07d-24e4-4114-be86-837e51ae7d83): created successfully Sep 10 18:31:04 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92289a6-2e5f-447e-9334-322a8fff9bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:04 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Flow 'volume_create_manager' (a1dfadcc-749f-486d-a130-3d5fd184c813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:04 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-11af51fa-b2db-471e-b045-a9559d002658 tempest-VolumesActionsTest-229338527 None] Created volume successfully. Sep 10 18:31:04 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] Created reservations ['9cb542e1-977a-4ce0-8710-2f4ee4ac25f7', '5fbd4fd9-3bdc-4610-9743-b3b043541749', 'ba25f339-1240-495a-8aaa-06e48876baa8', '59a50bd2-a348-4710-81f3-9acaffbedf03'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:31:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:04 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:31:04 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:31:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:04 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:31:04 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:05 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.333s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:05 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:31:05 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] Deleted volume successfully. Sep 10 18:31:05 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-68d85e5b-2aef-4e92-b285-7245a385d25c tempest-VolumesActionsTest-728127884 None] Lock "cinder-1d02698a-ab53-404d-9654-bd235f362e8f-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Flow 'volume_create_manager' (23b52174-3272-4aaf-8855-4691bc250e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9f61b9-2519-4cd4-96fe-8e1ae6ca59bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9f61b9-2519-4cd4-96fe-8e1ae6ca59bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1786649367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca41ebf8-58ed-4fdc-bf75-bd8838fac215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ece4294d71459a91805e8024c8177d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:06Z,use_quota=True,user_id='df01517f405e4906b3cea6e4ab69da0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef3ceb0-533f-40d6-b1c0-9050b7905198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef3ceb0-533f-40d6-b1c0-9050b7905198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd5821f-d13c-4a36-aae0-4c2ff61801da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd5821f-d13c-4a36-aae0-4c2ff61801da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca41ebf8-58ed-4fdc-bf75-bd8838fac215', 'volume_name': 'volume-ca41ebf8-58ed-4fdc-bf75-bd8838fac215', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1dc03b-01b7-490a-b432-186ade35b3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1dc03b-01b7-490a-b432-186ade35b3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4b31e2-65a9-4c32-86fa-0b794c9ac37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:06 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Volume ca41ebf8-58ed-4fdc-bf75-bd8838fac215: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca41ebf8-58ed-4fdc-bf75-bd8838fac215', 'volume_size': 1} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1786649367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca41ebf8-58ed-4fdc-bf75-bd8838fac215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ece4294d71459a91805e8024c8177d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:06Z,use_quota=True,user_id='df01517f405e4906b3cea6e4ab69da0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Creating volume ca41ebf8-58ed-4fdc-bf75-bd8838fac215 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:31:06 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ca41ebf8-58ed-4fdc-bf75-bd8838fac215 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:31:06 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ca41ebf8-58ed-4fdc-bf75-bd8838fac215 1073741824 Sep 10 18:31:06 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Flow 'volume_create_manager' (341f297c-cd71-478d-b8d3-21165a48207b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed4d3d4-7ab9-4fc2-8e46-3673be7d5867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed4d3d4-7ab9-4fc2-8e46-3673be7d5867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1229159224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a13b47-3e1d-4a31-8af4-08b31685e800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc5fd5c11074a63883a238ef1bf587f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:06Z,use_quota=True,user_id='9672d6d99dd94ca08687db1859fc9d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83956bcb-1398-4ca5-824a-7d5be90fd01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83956bcb-1398-4ca5-824a-7d5be90fd01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd2388f-dd98-4035-a18a-a0e6f9f67735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd2388f-dd98-4035-a18a-a0e6f9f67735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29a13b47-3e1d-4a31-8af4-08b31685e800', 'volume_name': 'volume-29a13b47-3e1d-4a31-8af4-08b31685e800', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b5b757-9f35-49cb-9556-1270feda1a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b5b757-9f35-49cb-9556-1270feda1a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8277ee0f-f622-479e-a933-03311c21b759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:06 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Volume 29a13b47-3e1d-4a31-8af4-08b31685e800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29a13b47-3e1d-4a31-8af4-08b31685e800', 'volume_size': 1} Sep 10 18:31:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:07 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ca41ebf8-58ed-4fdc-bf75-bd8838fac215 1073741824" returned: 0 in 0.703s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ca41ebf8-58ed-4fdc-bf75-bd8838fac215 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:07 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ca41ebf8-58ed-4fdc-bf75-bd8838fac215 Sep 10 18:31:07 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:07 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ca41ebf8-58ed-4fdc-bf75-bd8838fac215" returned: 0 in 0.495s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:07 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:31:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.077s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:07 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1229159224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a13b47-3e1d-4a31-8af4-08b31685e800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc5fd5c11074a63883a238ef1bf587f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:06Z,use_quota=True,user_id='9672d6d99dd94ca08687db1859fc9d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:31:07 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Creating volume 29a13b47-3e1d-4a31-8af4-08b31685e800 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:31:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:07 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:31:07 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:31:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:07 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:31:07 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:31:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4b31e2-65a9-4c32-86fa-0b794c9ac37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca41ebf8-58ed-4fdc-bf75-bd8838fac215', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0fa723-8695-4e70-96b6-a9360cab3421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:07 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800 1073741824 Sep 10 18:31:07 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:07 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Volume volume-ca41ebf8-58ed-4fdc-bf75-bd8838fac215 (ca41ebf8-58ed-4fdc-bf75-bd8838fac215): created successfully Sep 10 18:31:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0fa723-8695-4e70-96b6-a9360cab3421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Flow 'volume_create_manager' (23b52174-3272-4aaf-8855-4691bc250e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:08 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-3b84b7e0-34f6-4637-bf43-1759b6a55b82 tempest-VolumesActionsTest-310649298 None] Created volume successfully. Sep 10 18:31:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] Acquiring lock "cinder-ca41ebf8-58ed-4fdc-bf75-bd8838fac215-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] Lock "cinder-ca41ebf8-58ed-4fdc-bf75-bd8838fac215-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:08 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] Acquiring lock "cinder-quobyte-ca41ebf8-58ed-4fdc-bf75-bd8838fac215" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800 1073741824" returned: 0 in 0.987s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] Lock "cinder-quobyte-ca41ebf8-58ed-4fdc-bf75-bd8838fac215" acquired by "delete_volume" :: waited 0.042s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:08 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[50eed5ce-946f-4532-9266-a7412f7471a4]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:31:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ca41ebf8-58ed-4fdc-bf75-bd8838fac215 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:09 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800 Sep 10 18:31:09 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:09 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ca41ebf8-58ed-4fdc-bf75-bd8838fac215 Sep 10 18:31:09 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:09 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800" returned: 0 in 0.607s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:31:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8277ee0f-f622-479e-a933-03311c21b759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29a13b47-3e1d-4a31-8af4-08b31685e800', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd77d72c-876b-42f8-8e4c-f9d4e2396cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:09 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Volume volume-29a13b47-3e1d-4a31-8af4-08b31685e800 (29a13b47-3e1d-4a31-8af4-08b31685e800): created successfully Sep 10 18:31:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd77d72c-876b-42f8-8e4c-f9d4e2396cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:09 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Flow 'volume_create_manager' (341f297c-cd71-478d-b8d3-21165a48207b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ca41ebf8-58ed-4fdc-bf75-bd8838fac215" returned: 0 in 0.752s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ca41ebf8-58ed-4fdc-bf75-bd8838fac215 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:09 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-16e4ade0-cca6-4b92-9ee0-d1178cda8cca tempest-VolumeDependencyTests-1293992665 None] Created volume successfully. Sep 10 18:31:09 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ca41ebf8-58ed-4fdc-bf75-bd8838fac215 Sep 10 18:31:09 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:10 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ca41ebf8-58ed-4fdc-bf75-bd8838fac215" returned: 0 in 0.506s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] Lock "cinder-quobyte-ca41ebf8-58ed-4fdc-bf75-bd8838fac215" released by "delete_volume" :: held 1.329s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:10 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] Created reservations ['d32a4bc4-c429-411a-8f7f-f7b06cb26f5c', '6c0bd0fb-0f07-445e-80c7-f8ccf8f5ae6d', '72a509d6-3774-4ae3-afe1-e3d0c77c1b36', '92f5f869-1bd3-4db1-9598-2480d74f22b7'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:31:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:31:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:31:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:10 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:31:10 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:10 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.335s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:10 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:31:10 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] Deleted volume successfully. Sep 10 18:31:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8cee566a-eb1d-4e53-8a9d-3b1435e91577 tempest-VolumesActionsTest-728127884 None] Lock "cinder-ca41ebf8-58ed-4fdc-bf75-bd8838fac215-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ad357376-7424-4d92-a9f8-2e19c1180da4 tempest-VolumeDependencyTests-1293992665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ad357376-7424-4d92-a9f8-2e19c1180da4 tempest-VolumeDependencyTests-1293992665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-ad357376-7424-4d92-a9f8-2e19c1180da4 tempest-VolumeDependencyTests-1293992665 None] Creating offline snapshot bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 of volume 29a13b47-3e1d-4a31-8af4-08b31685e800 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:31:10 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8554d8-d740-4f20-90fa-5b2518ff4a8d]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:31:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ad357376-7424-4d92-a9f8-2e19c1180da4 tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:11 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800 Sep 10 18:31:11 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:11 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ad357376-7424-4d92-a9f8-2e19c1180da4 tempest-VolumeDependencyTests-1293992665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800" returned: 0 in 0.473s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ad357376-7424-4d92-a9f8-2e19c1180da4 tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:11 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 1G Sep 10 18:31:11 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:11 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:31:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Flow 'volume_create_manager' (c83a8697-c83e-40d4-b3ac-b2f6b6b445d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2728bc56-ee5e-4a10-9fb5-1e55e84502e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2728bc56-ee5e-4a10-9fb5-1e55e84502e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1251455752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d32622ef-2acc-491a-ad74-34d3f1c5ceeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ece4294d71459a91805e8024c8177d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:12Z,use_quota=True,user_id='df01517f405e4906b3cea6e4ab69da0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35f6e49-bb1f-4ec9-917f-95d71fd58618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35f6e49-bb1f-4ec9-917f-95d71fd58618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20aec5bc-fbac-4522-a65b-c43c9188b860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20aec5bc-fbac-4522-a65b-c43c9188b860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd32622ef-2acc-491a-ad74-34d3f1c5ceeb', 'volume_name': 'volume-d32622ef-2acc-491a-ad74-34d3f1c5ceeb', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32d3e10-c66e-428b-b81c-8a865841cbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32d3e10-c66e-428b-b81c-8a865841cbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f02eb9-25d2-4c40-9f53-a7a5579cfc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:12 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Volume d32622ef-2acc-491a-ad74-34d3f1c5ceeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d32622ef-2acc-491a-ad74-34d3f1c5ceeb', 'volume_size': 1} Sep 10 18:31:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:12 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ad357376-7424-4d92-a9f8-2e19c1180da4 tempest-VolumeDependencyTests-1293992665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 1G" returned: 0 in 0.748s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ad357376-7424-4d92-a9f8-2e19c1180da4 tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a13b47-3e1d-4a31-8af4-08b31685e800 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:12 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a13b47-3e1d-4a31-8af4-08b31685e800 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 Sep 10 18:31:12 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:12 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ad357376-7424-4d92-a9f8-2e19c1180da4 tempest-VolumeDependencyTests-1293992665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a13b47-3e1d-4a31-8af4-08b31685e800 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8" returned: 0 in 0.486s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:12 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-ad357376-7424-4d92-a9f8-2e19c1180da4 tempest-VolumeDependencyTests-1293992665 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 is being set with open permissions: ugo+rw Sep 10 18:31:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ad357376-7424-4d92-a9f8-2e19c1180da4 tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:12 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 Sep 10 18:31:12 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:13 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ad357376-7424-4d92-a9f8-2e19c1180da4 tempest-VolumeDependencyTests-1293992665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8" returned: 0 in 0.661s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ad357376-7424-4d92-a9f8-2e19c1180da4 tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:13 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.info Sep 10 18:31:13 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:13 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ad357376-7424-4d92-a9f8-2e19c1180da4 tempest-VolumeDependencyTests-1293992665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.info" returned: 0 in 0.543s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:14 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-ad357376-7424-4d92-a9f8-2e19c1180da4 tempest-VolumeDependencyTests-1293992665 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.info is being set with open permissions: ugo+rw Sep 10 18:31:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ad357376-7424-4d92-a9f8-2e19c1180da4 tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:14 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.info Sep 10 18:31:14 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:14 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ad357376-7424-4d92-a9f8-2e19c1180da4 tempest-VolumeDependencyTests-1293992665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.info" returned: 0 in 0.328s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ad357376-7424-4d92-a9f8-2e19c1180da4 tempest-VolumeDependencyTests-1293992665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.442s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.280s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1251455752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d32622ef-2acc-491a-ad74-34d3f1c5ceeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ece4294d71459a91805e8024c8177d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:12Z,use_quota=True,user_id='df01517f405e4906b3cea6e4ab69da0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:31:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Creating volume d32622ef-2acc-491a-ad74-34d3f1c5ceeb {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:31:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:31:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:31:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:31:14 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:31:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d32622ef-2acc-491a-ad74-34d3f1c5ceeb 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:14 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d32622ef-2acc-491a-ad74-34d3f1c5ceeb 1073741824 Sep 10 18:31:14 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:14 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ad357376-7424-4d92-a9f8-2e19c1180da4 tempest-VolumeDependencyTests-1293992665 None] Create snapshot completed successfully Sep 10 18:31:15 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d32622ef-2acc-491a-ad74-34d3f1c5ceeb 1073741824" returned: 0 in 0.680s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d32622ef-2acc-491a-ad74-34d3f1c5ceeb {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:15 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d32622ef-2acc-491a-ad74-34d3f1c5ceeb Sep 10 18:31:15 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:15 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d32622ef-2acc-491a-ad74-34d3f1c5ceeb" returned: 0 in 0.333s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:31:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f02eb9-25d2-4c40-9f53-a7a5579cfc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d32622ef-2acc-491a-ad74-34d3f1c5ceeb', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871f31da-1aeb-4935-9bd0-55baca79bb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:15 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Volume volume-d32622ef-2acc-491a-ad74-34d3f1c5ceeb (d32622ef-2acc-491a-ad74-34d3f1c5ceeb): created successfully Sep 10 18:31:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871f31da-1aeb-4935-9bd0-55baca79bb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Flow 'volume_create_manager' (c83a8697-c83e-40d4-b3ac-b2f6b6b445d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:15 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-85980daf-cdc7-4086-adab-ff9be37f6d0c tempest-VolumesActionsTest-310649298 None] Created volume successfully. Sep 10 18:31:15 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:31:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Flow 'volume_create_manager' (b6889278-df95-4092-a61c-6730eb783177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0cd1802-04fa-4372-952e-cfe50621bc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0cd1802-04fa-4372-952e-cfe50621bc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1241764060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a38db56-d200-4f8e-a79c-0a144d66aabb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc5fd5c11074a63883a238ef1bf587f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:16Z,use_quota=True,user_id='9672d6d99dd94ca08687db1859fc9d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ea0fe9-67b3-43e4-a4d3-4b467b461705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ea0fe9-67b3-43e4-a4d3-4b467b461705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77197339-d87e-4f67-93fa-ba5f3c45a2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77197339-d87e-4f67-93fa-ba5f3c45a2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8a38db56-d200-4f8e-a79c-0a144d66aabb', 'volume_name': 'volume-8a38db56-d200-4f8e-a79c-0a144d66aabb', 'volume_size': 1, 'snapshot_id': 'bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be843954-4ad9-447b-8799-a7626c67c1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be843954-4ad9-447b-8799-a7626c67c1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a1bf21-3ec3-46e9-b4b0-8fdc0aaca32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:16 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Volume 8a38db56-d200-4f8e-a79c-0a144d66aabb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8a38db56-d200-4f8e-a79c-0a144d66aabb', 'volume_size': 1, 'snapshot_id': 'bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8'} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Acquiring lock "cinder-quobyte-bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8-8a38db56-d200-4f8e-a79c-0a144d66aabb" by "_create_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Lock "cinder-quobyte-bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8-8a38db56-d200-4f8e-a79c-0a144d66aabb" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Creating volume 8a38db56-d200-4f8e-a79c-0a144d66aabb from snapshot bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 {{(pid=87842) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Acquiring lock "cinder-quobyte-8a38db56-d200-4f8e-a79c-0a144d66aabb" by "_copy_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Lock "cinder-quobyte-8a38db56-d200-4f8e-a79c-0a144d66aabb" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] snapshot: bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8, volume: 8a38db56-d200-4f8e-a79c-0a144d66aabb, {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7858c6a8-d74e-45ef-b0c5-e8f7a3baf06d]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:16 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 Sep 10 18:31:16 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-68993c45-a188-49fb-a6ff-4e3d8340a0ba tempest-VolumesActionsTest-229338527 None] Acquiring lock "cinder-ddd8c07d-24e4-4114-be86-837e51ae7d83" by "attach_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-68993c45-a188-49fb-a6ff-4e3d8340a0ba tempest-VolumesActionsTest-229338527 None] Lock "cinder-ddd8c07d-24e4-4114-be86-837e51ae7d83" acquired by "attach_volume" :: waited 0.033s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] Acquiring lock "cinder-d32622ef-2acc-491a-ad74-34d3f1c5ceeb-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] Lock "cinder-d32622ef-2acc-491a-ad74-34d3f1c5ceeb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:16 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-68993c45-a188-49fb-a6ff-4e3d8340a0ba tempest-VolumesActionsTest-229338527 None] Attaching volume ddd8c07d-24e4-4114-be86-837e51ae7d83 to instance 337c5f40-2155-45dc-a253-bbabddb62567 at mountpoint /dev/vdb on host None. Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] Acquiring lock "cinder-quobyte-d32622ef-2acc-491a-ad74-34d3f1c5ceeb" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:16 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-68993c45-a188-49fb-a6ff-4e3d8340a0ba tempest-VolumesActionsTest-229338527 None] Attach volume completed successfully. Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] Lock "cinder-quobyte-d32622ef-2acc-491a-ad74-34d3f1c5ceeb" acquired by "delete_volume" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-68993c45-a188-49fb-a6ff-4e3d8340a0ba tempest-VolumesActionsTest-229338527 None] Lock "cinder-ddd8c07d-24e4-4114-be86-837e51ae7d83" released by "attach_volume" :: held 0.216s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[538fe56e-ff4f-4d18-82ba-e28da78a9efa]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d32622ef-2acc-491a-ad74-34d3f1c5ceeb {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:16 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d32622ef-2acc-491a-ad74-34d3f1c5ceeb Sep 10 18:31:16 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:16 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8" returned: 0 in 0.662s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29a13b47-3e1d-4a31-8af4-08b31685e800(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-22eb570b-06c0-40af-a44e-b1ba4af35a65 tempest-VolumesActionsTest-229338527 None] Acquiring lock "cinder-ddd8c07d-24e4-4114-be86-837e51ae7d83-detach_volume" by "detach_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee4e0e8-3ad7-4cd6-84cf-7c31621b3bec]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:31:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-22eb570b-06c0-40af-a44e-b1ba4af35a65 tempest-VolumesActionsTest-229338527 None] Lock "cinder-ddd8c07d-24e4-4114-be86-837e51ae7d83-detach_volume" acquired by "detach_volume" :: waited 0.073s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:17 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-22eb570b-06c0-40af-a44e-b1ba4af35a65 tempest-VolumesActionsTest-229338527 None] Detaching volume ddd8c07d-24e4-4114-be86-837e51ae7d83 from instance 337c5f40-2155-45dc-a253-bbabddb62567. Sep 10 18:31:17 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-22eb570b-06c0-40af-a44e-b1ba4af35a65 tempest-VolumesActionsTest-229338527 None] Detach volume completed successfully. Sep 10 18:31:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-22eb570b-06c0-40af-a44e-b1ba4af35a65 tempest-VolumesActionsTest-229338527 None] Lock "cinder-ddd8c07d-24e4-4114-be86-837e51ae7d83-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:17 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800 Sep 10 18:31:17 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:17 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d32622ef-2acc-491a-ad74-34d3f1c5ceeb" returned: 0 in 0.509s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d32622ef-2acc-491a-ad74-34d3f1c5ceeb {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:17 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d32622ef-2acc-491a-ad74-34d3f1c5ceeb Sep 10 18:31:17 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:17 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800" returned: 0 in 0.524s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800 {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 18:31:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Creating direct copy from snapshot {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 18:31:17 devstack cinder-volume[87842]: DEBUG cinder.utils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Path /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8a38db56-d200-4f8e-a79c-0a144d66aabb not found in is_blk_device check {{(pid=87842) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 18:31:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8a38db56-d200-4f8e-a79c-0a144d66aabb {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:17 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8a38db56-d200-4f8e-a79c-0a144d66aabb Sep 10 18:31:17 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:17 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d32622ef-2acc-491a-ad74-34d3f1c5ceeb" returned: 0 in 0.346s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] Lock "cinder-quobyte-d32622ef-2acc-491a-ad74-34d3f1c5ceeb" released by "delete_volume" :: held 0.915s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:17 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] Created reservations ['8b5a0bb2-204d-469e-94ef-8dfc44fd0a03', 'c63869ae-e407-41d1-aca7-81def23d8591', '8bfde868-a627-489f-b8fc-c8032ec7d637', '0b8c0ce3-04de-4361-8dfe-9d98bf0cfd7a'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:31:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:31:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:31:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:17 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:31:17 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:18 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.408s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:18 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:31:18 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] Deleted volume successfully. Sep 10 18:31:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4533001d-6227-4848-9213-a4fa2f2624ba tempest-VolumesActionsTest-728127884 None] Lock "cinder-d32622ef-2acc-491a-ad74-34d3f1c5ceeb-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:20 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:31:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Flow 'volume_create_manager' (efe158ce-71d9-4e85-9edd-adb72e352219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f375340b-7a62-4f2c-ac5d-ba7b2d36d80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f375340b-7a62-4f2c-ac5d-ba7b2d36d80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-357801417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d253440-62b3-43a1-a3d8-cede9f301894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ece4294d71459a91805e8024c8177d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:21Z,use_quota=True,user_id='df01517f405e4906b3cea6e4ab69da0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4dbe0c5-5bcd-4e05-a21c-cd8997b69957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4dbe0c5-5bcd-4e05-a21c-cd8997b69957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ddf5aa-dc93-405b-82c1-238629de643c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ddf5aa-dc93-405b-82c1-238629de643c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d253440-62b3-43a1-a3d8-cede9f301894', 'volume_name': 'volume-9d253440-62b3-43a1-a3d8-cede9f301894', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce511e46-9d55-487e-8958-f80e6315dd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce511e46-9d55-487e-8958-f80e6315dd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb2f137-e4cb-4e99-b770-0c5c61b624e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:20 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Volume 9d253440-62b3-43a1-a3d8-cede9f301894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d253440-62b3-43a1-a3d8-cede9f301894', 'volume_size': 1} Sep 10 18:31:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:23 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8a38db56-d200-4f8e-a79c-0a144d66aabb" returned: 0 in 5.838s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Image conversion details: src /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8a38db56-d200-4f8e-a79c-0a144d66aabb {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:31:23 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Converted 1024.00 MB image at 175.38 MB/s Sep 10 18:31:23 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8a38db56-d200-4f8e-a79c-0a144d66aabb is being set with open permissions: ugo+rw Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8a38db56-d200-4f8e-a79c-0a144d66aabb {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:23 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8a38db56-d200-4f8e-a79c-0a144d66aabb Sep 10 18:31:23 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:23 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8a38db56-d200-4f8e-a79c-0a144d66aabb" returned: 0 in 0.269s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Lock "cinder-quobyte-8a38db56-d200-4f8e-a79c-0a144d66aabb" released by "_copy_volume_from_snapshot" :: held 7.476s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Lock "cinder-quobyte-bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8-8a38db56-d200-4f8e-a79c-0a144d66aabb" released by "_create_volume_from_snapshot" :: held 7.593s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.628s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.955s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-357801417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d253440-62b3-43a1-a3d8-cede9f301894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ece4294d71459a91805e8024c8177d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:21Z,use_quota=True,user_id='df01517f405e4906b3cea6e4ab69da0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Creating volume 9d253440-62b3-43a1-a3d8-cede9f301894 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:31:23 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9d253440-62b3-43a1-a3d8-cede9f301894 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:23 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9d253440-62b3-43a1-a3d8-cede9f301894 1073741824 Sep 10 18:31:23 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a1bf21-3ec3-46e9-b4b0-8fdc0aaca32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a38db56-d200-4f8e-a79c-0a144d66aabb', 'volume_size': 1, 'snapshot_id': 'bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee223bb-9ecf-4d70-a89b-6da2e8e732e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:23 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Volume volume-8a38db56-d200-4f8e-a79c-0a144d66aabb (8a38db56-d200-4f8e-a79c-0a144d66aabb): created successfully Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee223bb-9ecf-4d70-a89b-6da2e8e732e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Flow 'volume_create_manager' (b6889278-df95-4092-a61c-6730eb783177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:23 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f6477056-3975-433e-aeea-064b816749d9 tempest-VolumeDependencyTests-1293992665 None] Created volume successfully. Sep 10 18:31:24 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9d253440-62b3-43a1-a3d8-cede9f301894 1073741824" returned: 0 in 0.493s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9d253440-62b3-43a1-a3d8-cede9f301894 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:24 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9d253440-62b3-43a1-a3d8-cede9f301894 Sep 10 18:31:24 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:24 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9d253440-62b3-43a1-a3d8-cede9f301894" returned: 0 in 0.244s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:24 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:31:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb2f137-e4cb-4e99-b770-0c5c61b624e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d253440-62b3-43a1-a3d8-cede9f301894', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d726a56b-2617-4058-a74f-3323218db68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:24 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Volume volume-9d253440-62b3-43a1-a3d8-cede9f301894 (9d253440-62b3-43a1-a3d8-cede9f301894): created successfully Sep 10 18:31:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d726a56b-2617-4058-a74f-3323218db68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:24 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Flow 'volume_create_manager' (efe158ce-71d9-4e85-9edd-adb72e352219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:24 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-007275a3-4ad7-4fcf-9cce-3dbd1122188e tempest-VolumesActionsTest-310649298 None] Created volume successfully. Sep 10 18:31:24 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] Acquiring lock "cinder-bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:24 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] Lock "cinder-bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:24 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] Acquiring lock "cinder-quobyte-29a13b47-3e1d-4a31-8af4-08b31685e800" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:24 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] Lock "cinder-quobyte-29a13b47-3e1d-4a31-8af4-08b31685e800" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:24 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] Acquiring lock "cinder-quobyte-bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] Lock "cinder-quobyte-bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:25 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] Deleting offline snapshot bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 of volume 29a13b47-3e1d-4a31-8af4-08b31685e800 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:31:25 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] snapshot_file for this snap is: volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:31:25 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2db838-ec9d-4d10-90c0-2e45e2e842ef]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:31:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] Acquiring lock "cinder-9d253440-62b3-43a1-a3d8-cede9f301894-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] Lock "cinder-9d253440-62b3-43a1-a3d8-cede9f301894-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] Acquiring lock "cinder-quobyte-9d253440-62b3-43a1-a3d8-cede9f301894" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] Lock "cinder-quobyte-9d253440-62b3-43a1-a3d8-cede9f301894" acquired by "delete_volume" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:25 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 Sep 10 18:31:25 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:25 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08190cc-de98-4eaf-8058-bfb0364ada44]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:31:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9d253440-62b3-43a1-a3d8-cede9f301894 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:25 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9d253440-62b3-43a1-a3d8-cede9f301894 Sep 10 18:31:25 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:25 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8" returned: 0 in 0.461s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:25 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29a13b47-3e1d-4a31-8af4-08b31685e800(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:31:25 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d9efc1-eda4-4927-b496-f7fa58a51164]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:31:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:25 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800 Sep 10 18:31:25 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:25 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9d253440-62b3-43a1-a3d8-cede9f301894" returned: 0 in 0.514s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9d253440-62b3-43a1-a3d8-cede9f301894 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:25 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9d253440-62b3-43a1-a3d8-cede9f301894 Sep 10 18:31:25 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:26 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9d253440-62b3-43a1-a3d8-cede9f301894" returned: 0 in 0.318s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:26 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] Lock "cinder-quobyte-9d253440-62b3-43a1-a3d8-cede9f301894" released by "delete_volume" :: held 0.894s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:26 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] Created reservations ['09c243ef-ddf8-41a7-93dc-2cbf2ab19b05', 'd3e4b8e2-b93a-4f60-b6ea-318aa7948aa4', 'f034a124-09c6-4d3a-bf16-5c072a2f5140', 'ed39a96c-0b5f-4c6c-aa45-bfc0829b10b7'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:31:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:26 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:31:26 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:31:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:26 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:31:26 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:26 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800" returned: 0 in 0.729s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:26 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 Sep 10 18:31:26 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:26 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.300s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:26 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:31:26 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] Deleted volume successfully. Sep 10 18:31:26 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8c2308ca-0c27-4186-91b2-6eefff94efb5 tempest-VolumesActionsTest-728127884 None] Lock "cinder-9d253440-62b3-43a1-a3d8-cede9f301894-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:26 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8" returned: 0 in 0.403s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:26 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8 Sep 10 18:31:26 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:26 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:31:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Flow 'volume_create_manager' (05ebf3e3-2c82-487a-9edc-65956b5a9f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae919fc1-bb55-4b08-922d-692a97b40669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae919fc1-bb55-4b08-922d-692a97b40669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1555077574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0db1af3-1c58-4bee-83b1-df47bbec651e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ece4294d71459a91805e8024c8177d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:27Z,use_quota=True,user_id='df01517f405e4906b3cea6e4ab69da0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b2b8060-e387-4882-97a3-17f303aef320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b2b8060-e387-4882-97a3-17f303aef320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:27 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab5c990-fd8a-403b-ba02-f9dfccd78c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab5c990-fd8a-403b-ba02-f9dfccd78c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0db1af3-1c58-4bee-83b1-df47bbec651e', 'volume_name': 'volume-f0db1af3-1c58-4bee-83b1-df47bbec651e', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69aa4b8-e6ca-46ae-b570-5375176286c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69aa4b8-e6ca-46ae-b570-5375176286c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c719d6e0-c1da-4ef9-94fc-0c657e04d824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:27 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Volume f0db1af3-1c58-4bee-83b1-df47bbec651e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0db1af3-1c58-4bee-83b1-df47bbec651e', 'volume_size': 1} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1555077574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0db1af3-1c58-4bee-83b1-df47bbec651e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ece4294d71459a91805e8024c8177d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:27Z,use_quota=True,user_id='df01517f405e4906b3cea6e4ab69da0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Creating volume f0db1af3-1c58-4bee-83b1-df47bbec651e {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:31:27 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0db1af3-1c58-4bee-83b1-df47bbec651e 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800.bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8" returned: 0 in 0.355s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:27 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0db1af3-1c58-4bee-83b1-df47bbec651e 1073741824 Sep 10 18:31:27 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] Lock "cinder-quobyte-bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8" released by "_delete_snapshot" :: held 2.100s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] Lock "cinder-quobyte-29a13b47-3e1d-4a31-8af4-08b31685e800" released by "delete_snapshot" :: held 2.132s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] Created reservations ['b08a09a2-3c51-4b89-ae8f-fd634cac486b', '70be5d12-11cb-498b-b071-d6075ef2135d', '6c63dace-7507-4189-a0b9-ccddcf5767e2', 'ec5f2535-5db7-4b07-9c22-addf1aeb25b3'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:31:27 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] Delete snapshot completed successfully. Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ef3449bc-2fe6-4a64-bd69-d8da450af21f tempest-VolumeDependencyTests-1293992665 None] Lock "cinder-bfe0b8e6-b5d4-4ac7-97b8-b4b76ab55df8-delete_snapshot" released by "delete_snapshot" :: held 2.357s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0db1af3-1c58-4bee-83b1-df47bbec651e 1073741824" returned: 0 in 0.555s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:27 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0db1af3-1c58-4bee-83b1-df47bbec651e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:27 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0db1af3-1c58-4bee-83b1-df47bbec651e Sep 10 18:31:27 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:28 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0db1af3-1c58-4bee-83b1-df47bbec651e" returned: 0 in 0.485s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:31:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:28 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] Acquiring lock "cinder-29a13b47-3e1d-4a31-8af4-08b31685e800-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c719d6e0-c1da-4ef9-94fc-0c657e04d824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0db1af3-1c58-4bee-83b1-df47bbec651e', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3e7985-61dc-4d25-9b5d-3f271dda1db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:28 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] Lock "cinder-29a13b47-3e1d-4a31-8af4-08b31685e800-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:28 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Volume volume-f0db1af3-1c58-4bee-83b1-df47bbec651e (f0db1af3-1c58-4bee-83b1-df47bbec651e): created successfully Sep 10 18:31:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3e7985-61dc-4d25-9b5d-3f271dda1db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Flow 'volume_create_manager' (05ebf3e3-2c82-487a-9edc-65956b5a9f04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:28 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-229829c7-7da1-4f28-a898-eeec245d3ef1 tempest-VolumesActionsTest-310649298 None] Created volume successfully. Sep 10 18:31:28 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] Acquiring lock "cinder-quobyte-29a13b47-3e1d-4a31-8af4-08b31685e800" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:28 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] Lock "cinder-quobyte-29a13b47-3e1d-4a31-8af4-08b31685e800" acquired by "delete_volume" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:28 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9532f12c-505a-42cb-83ff-754e0490d2f7]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:31:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:28 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800 Sep 10 18:31:28 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:31:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:31:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:31:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:29 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:31:29 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:29 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800" returned: 0 in 0.738s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:29 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800 Sep 10 18:31:29 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:29 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.461s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:31:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:31:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 28 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:31:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:31:29 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29a13b47-3e1d-4a31-8af4-08b31685e800" returned: 0 in 0.555s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] Lock "cinder-quobyte-29a13b47-3e1d-4a31-8af4-08b31685e800" released by "delete_volume" :: held 1.430s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:29 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] Created reservations ['08c3d3aa-db6a-4515-bc12-9fc3bb3e8e18', 'd380f4d0-a98b-40b7-898e-f90f390a2f93', '5bfa3573-386c-4cfa-b006-be83c38ee7b3', '6ea5d4e3-26ef-4a7d-a703-e08c7915e5ad'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-3b1fd95f-e844-4ac6-bbc6-5976fb494004 req-8313d710-80ed-428e-b9a6-9013875eda71 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-3b1fd95f-e844-4ac6-bbc6-5976fb494004 req-8313d710-80ed-428e-b9a6-9013875eda71 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-3b1fd95f-e844-4ac6-bbc6-5976fb494004 req-8313d710-80ed-428e-b9a6-9013875eda71 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-3b1fd95f-e844-4ac6-bbc6-5976fb494004 req-8313d710-80ed-428e-b9a6-9013875eda71 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-fdb3fc2a-ea43-4281-b1a3-7234f51922ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '308bfab6-75a3-4cb7-925a-6a48f31bd56e', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:31:30 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:31:30 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] Acquiring lock "cinder-f0db1af3-1c58-4bee-83b1-df47bbec651e-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] Lock "cinder-f0db1af3-1c58-4bee-83b1-df47bbec651e-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] Acquiring lock "cinder-quobyte-f0db1af3-1c58-4bee-83b1-df47bbec651e" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:30 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-3b1fd95f-e844-4ac6-bbc6-5976fb494004 req-8313d710-80ed-428e-b9a6-9013875eda71 tempest-TestServerVolumeAttachmentScenario-1688598671 None] attachment_update completed successfully. Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] Lock "cinder-quobyte-f0db1af3-1c58-4bee-83b1-df47bbec651e" acquired by "delete_volume" :: waited 0.038s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c9532f-5038-41a2-ae02-0deb7dfae533]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0db1af3-1c58-4bee-83b1-df47bbec651e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:30 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.510s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:31:30 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] Deleted volume successfully. Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] Acquiring lock "cinder-8a38db56-d200-4f8e-a79c-0a144d66aabb-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-740f6b4e-204b-485c-b26e-40a35a8bdc75 tempest-VolumesActionsTest-229338527 None] Acquiring lock "cinder-ddd8c07d-24e4-4114-be86-837e51ae7d83" by "attach_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c1c67c6b-61df-4aba-a445-941e116f1e15 tempest-VolumeDependencyTests-1293992665 None] Lock "cinder-29a13b47-3e1d-4a31-8af4-08b31685e800-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] Lock "cinder-8a38db56-d200-4f8e-a79c-0a144d66aabb-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:30 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0db1af3-1c58-4bee-83b1-df47bbec651e Sep 10 18:31:30 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-740f6b4e-204b-485c-b26e-40a35a8bdc75 tempest-VolumesActionsTest-229338527 None] Lock "cinder-ddd8c07d-24e4-4114-be86-837e51ae7d83" acquired by "attach_volume" :: waited 0.067s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] Acquiring lock "cinder-quobyte-8a38db56-d200-4f8e-a79c-0a144d66aabb" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] Lock "cinder-quobyte-8a38db56-d200-4f8e-a79c-0a144d66aabb" acquired by "delete_volume" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d059cb-0c73-43cf-9060-f2a58c06c6aa]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:31:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8a38db56-d200-4f8e-a79c-0a144d66aabb {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:30 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-740f6b4e-204b-485c-b26e-40a35a8bdc75 tempest-VolumesActionsTest-229338527 None] Attaching volume ddd8c07d-24e4-4114-be86-837e51ae7d83 to instance 5fb2a028-c841-41b6-a2f3-937242eb01b1 at mountpoint /dev/vdb on host None. Sep 10 18:31:31 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-740f6b4e-204b-485c-b26e-40a35a8bdc75 tempest-VolumesActionsTest-229338527 None] Attach volume completed successfully. Sep 10 18:31:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-740f6b4e-204b-485c-b26e-40a35a8bdc75 tempest-VolumesActionsTest-229338527 None] Lock "cinder-ddd8c07d-24e4-4114-be86-837e51ae7d83" released by "attach_volume" :: held 0.211s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:31 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8a38db56-d200-4f8e-a79c-0a144d66aabb Sep 10 18:31:31 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:31 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0db1af3-1c58-4bee-83b1-df47bbec651e" returned: 0 in 0.727s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0db1af3-1c58-4bee-83b1-df47bbec651e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:31 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0db1af3-1c58-4bee-83b1-df47bbec651e Sep 10 18:31:31 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:31 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8a38db56-d200-4f8e-a79c-0a144d66aabb" returned: 0 in 0.703s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8a38db56-d200-4f8e-a79c-0a144d66aabb {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:31 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8a38db56-d200-4f8e-a79c-0a144d66aabb Sep 10 18:31:31 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1baa364a-568a-47d9-a195-564256bc6398 tempest-VolumesActionsTest-229338527 None] Acquiring lock "cinder-ddd8c07d-24e4-4114-be86-837e51ae7d83-detach_volume" by "detach_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:31:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1baa364a-568a-47d9-a195-564256bc6398 tempest-VolumesActionsTest-229338527 None] Lock "cinder-ddd8c07d-24e4-4114-be86-837e51ae7d83-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:31:31 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-1baa364a-568a-47d9-a195-564256bc6398 tempest-VolumesActionsTest-229338527 None] Detaching volume ddd8c07d-24e4-4114-be86-837e51ae7d83 from instance 5fb2a028-c841-41b6-a2f3-937242eb01b1. Sep 10 18:31:31 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0db1af3-1c58-4bee-83b1-df47bbec651e" returned: 0 in 0.527s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] Lock "cinder-quobyte-f0db1af3-1c58-4bee-83b1-df47bbec651e" released by "delete_volume" :: held 1.403s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:31 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-1baa364a-568a-47d9-a195-564256bc6398 tempest-VolumesActionsTest-229338527 None] Detach volume completed successfully. Sep 10 18:31:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1baa364a-568a-47d9-a195-564256bc6398 tempest-VolumesActionsTest-229338527 None] Lock "cinder-ddd8c07d-24e4-4114-be86-837e51ae7d83-detach_volume" released by "detach_volume" :: held 0.154s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:31 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] Created reservations ['aa5fd1dd-c6e2-4077-8b96-4f2b24ef0eae', '14be106e-e736-4c4e-9a7c-2eb670592499', '40656ed7-7468-447a-8e30-b23fbe1a6b60', '31e4d6f8-f68a-4f25-aa4b-6059af0078b7'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:31:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:31:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:31:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:32 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:31:32 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:32 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8a38db56-d200-4f8e-a79c-0a144d66aabb" returned: 0 in 0.603s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] Lock "cinder-quobyte-8a38db56-d200-4f8e-a79c-0a144d66aabb" released by "delete_volume" :: held 1.368s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:32 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] Created reservations ['0f46a5c9-75ff-47e4-9f5e-53c71869c076', '4aa2aafb-adc7-408c-b338-a276e3795061', '8a069d04-734f-46e9-9924-e154e009c325', '0d6347a9-f0eb-4633-a5f4-772919a07d81'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:31:32 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.359s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:32 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:31:32 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] Deleted volume successfully. Sep 10 18:31:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-11c3dfc5-172a-4bb6-b911-00c0c02b647f tempest-VolumesActionsTest-310649298 None] Lock "cinder-f0db1af3-1c58-4bee-83b1-df47bbec651e-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:31:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:31:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:32 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:31:32 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:33 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.500s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:33 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:31:33 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] Deleted volume successfully. Sep 10 18:31:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-05408a6d-e835-4fae-81f2-10c428f252c2 tempest-VolumeDependencyTests-1293992665 None] Lock "cinder-8a38db56-d200-4f8e-a79c-0a144d66aabb-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Flow 'volume_create_manager' (1ae0be86-4fa6-4bc1-951b-76cd2d7372ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c81eb5d-e050-4f4e-a94e-d0f40b01fd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c81eb5d-e050-4f4e-a94e-d0f40b01fd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdcea5b3-0a97-4742-b628-89a3745cc604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d6eb6d1af848528574be0115592880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:37Z,use_quota=True,user_id='c8df80285f684acab13028c90b540a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936fb27a-4e40-45f0-93dd-512412e5a6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936fb27a-4e40-45f0-93dd-512412e5a6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd219ba9-2b5e-481d-b586-42dfb876288c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd219ba9-2b5e-481d-b586-42dfb876288c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdcea5b3-0a97-4742-b628-89a3745cc604', 'volume_name': 'volume-cdcea5b3-0a97-4742-b628-89a3745cc604', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e70578-0a37-4d4e-a927-47e95ee60549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e70578-0a37-4d4e-a927-47e95ee60549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7097aa-bf20-44c6-97cc-b4e17819bc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:37 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Volume cdcea5b3-0a97-4742-b628-89a3745cc604: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdcea5b3-0a97-4742-b628-89a3745cc604', 'volume_size': 1} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdcea5b3-0a97-4742-b628-89a3745cc604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d6eb6d1af848528574be0115592880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:37Z,use_quota=True,user_id='c8df80285f684acab13028c90b540a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Creating volume cdcea5b3-0a97-4742-b628-89a3745cc604 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:31:37 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:31:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cdcea5b3-0a97-4742-b628-89a3745cc604 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:37 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cdcea5b3-0a97-4742-b628-89a3745cc604 1073741824 Sep 10 18:31:37 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-837760e1-bc7b-4d8e-84c0-2822f243bdfb tempest-VolumesActionsTest-229338527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:38 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cdcea5b3-0a97-4742-b628-89a3745cc604 1073741824" returned: 0 in 0.632s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cdcea5b3-0a97-4742-b628-89a3745cc604 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:38 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cdcea5b3-0a97-4742-b628-89a3745cc604 Sep 10 18:31:38 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-39ece10d-2861-4d2a-bb0f-0b4f380d55dd req-64f49cba-7ce3-4ead-8e4d-d44940b2aa3f tempest-TestServerVolumeAttachmentScenario-1688598671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:38 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cdcea5b3-0a97-4742-b628-89a3745cc604" returned: 0 in 0.278s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:31:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:31:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-837760e1-bc7b-4d8e-84c0-2822f243bdfb tempest-VolumesActionsTest-229338527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.624s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:31:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7097aa-bf20-44c6-97cc-b4e17819bc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdcea5b3-0a97-4742-b628-89a3745cc604', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb8d078-73e7-4584-ae62-588682b23fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:38 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[95708802-e295-419f-9b2f-8a56878be12d]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:31:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-837760e1-bc7b-4d8e-84c0-2822f243bdfb tempest-VolumesActionsTest-229338527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:38 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Volume volume-cdcea5b3-0a97-4742-b628-89a3745cc604 (cdcea5b3-0a97-4742-b628-89a3745cc604): created successfully Sep 10 18:31:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb8d078-73e7-4584-ae62-588682b23fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Flow 'volume_create_manager' (1ae0be86-4fa6-4bc1-951b-76cd2d7372ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:38 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-6666cedb-2001-477b-8e0b-91db2952cbea tempest-CinderUnicodeTest-1028312751 None] Created volume successfully. Sep 10 18:31:38 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 Sep 10 18:31:38 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:39 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-837760e1-bc7b-4d8e-84c0-2822f243bdfb tempest-VolumesActionsTest-229338527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83" returned: 0 in 0.385s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:39 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be67e9c-1da3-44ab-936b-396296135f58]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:31:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-837760e1-bc7b-4d8e-84c0-2822f243bdfb tempest-VolumesActionsTest-229338527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:39 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 Sep 10 18:31:39 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:39 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-837760e1-bc7b-4d8e-84c0-2822f243bdfb tempest-VolumesActionsTest-229338527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83" returned: 0 in 0.424s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-837760e1-bc7b-4d8e-84c0-2822f243bdfb tempest-VolumesActionsTest-229338527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 /opt/stack/data/cinder/conversion/ddd8c07d-24e4-4114-be86-837e51ae7d83.temp_image.df86fab8-d015-4594-a2dc-faf683ea0cacgrb46k92.img {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:39 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 /opt/stack/data/cinder/conversion/ddd8c07d-24e4-4114-be86-837e51ae7d83.temp_image.df86fab8-d015-4594-a2dc-faf683ea0cacgrb46k92.img Sep 10 18:31:39 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:40 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:31:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Flow 'volume_create_manager' (11ba1b66-636e-48b8-acad-9ffef9fbd25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa75bf6-cbff-4d7e-9562-7fbfbdc606d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa75bf6-cbff-4d7e-9562-7fbfbdc606d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-855224921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafe9ae4-b63b-4978-956b-cb11fe3bc600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d6eb6d1af848528574be0115592880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:41Z,use_quota=True,user_id='c8df80285f684acab13028c90b540a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7349ad7-049d-4ba1-b0d9-92b70c4717ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7349ad7-049d-4ba1-b0d9-92b70c4717ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab635c2-c1c6-40d4-a9d8-e4eab2c2aa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab635c2-c1c6-40d4-a9d8-e4eab2c2aa11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aafe9ae4-b63b-4978-956b-cb11fe3bc600', 'volume_name': 'volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82232a17-a67d-4a4d-b1dd-80c02a6baafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82232a17-a67d-4a4d-b1dd-80c02a6baafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7daf2e4c-1423-497d-beaa-f182c790818e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:40 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Volume aafe9ae4-b63b-4978-956b-cb11fe3bc600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600', 'volume_size': 1} Sep 10 18:31:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:31:44 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-837760e1-bc7b-4d8e-84c0-2822f243bdfb tempest-VolumesActionsTest-229338527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 /opt/stack/data/cinder/conversion/ddd8c07d-24e4-4114-be86-837e51ae7d83.temp_image.df86fab8-d015-4594-a2dc-faf683ea0cacgrb46k92.img" returned: 0 in 4.719s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:44 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad648bd5-aae4-4000-a16e-58a95eda9bd1]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:31:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-837760e1-bc7b-4d8e-84c0-2822f243bdfb tempest-VolumesActionsTest-229338527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:31:44 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 Sep 10 18:31:44 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:31:44 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Sep 10 18:31:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-837760e1-bc7b-4d8e-84c0-2822f243bdfb tempest-VolumesActionsTest-229338527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83" returned: 0 in 0.603s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:31:44 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-837760e1-bc7b-4d8e-84c0-2822f243bdfb tempest-VolumesActionsTest-229338527 None] Image conversion details: src /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83, size 1024.00 MB, duration 4.72 sec, destination /opt/stack/data/cinder/conversion/ddd8c07d-24e4-4114-be86-837e51ae7d83.temp_image.df86fab8-d015-4594-a2dc-faf683ea0cacgrb46k92.img {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:31:44 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-837760e1-bc7b-4d8e-84c0-2822f243bdfb tempest-VolumesActionsTest-229338527 None] Converted 1024.00 MB image at 216.88 MB/s Sep 10 18:31:44 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-837760e1-bc7b-4d8e-84c0-2822f243bdfb tempest-VolumesActionsTest-229338527 None] df86fab8-d015-4594-a2dc-faf683ea0cac was raw, no need to convert to raw {{(pid=87842) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 10 18:31:50 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=88,cinder:INSERT=33,cinder:UPDATE=115,cinder:DELETE=8 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:31:54 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=103,cinder:INSERT=21,cinder:UPDATE=113,cinder:DELETE=11 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:31:54 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:31:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Flow 'volume_create_manager' (38ca7f9d-764a-4108-a96c-48b2fed8ea3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:31:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92af4ec-eddf-49d5-bb17-7ffbaeed0d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92af4ec-eddf-49d5-bb17-7ffbaeed0d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1892255321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f03f6d275641dbba61ecb827ebabe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:55Z,use_quota=True,user_id='d6e88b0921584b1ea66febe8c1097b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6931da82-addf-4321-8482-a546a4f43403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6931da82-addf-4321-8482-a546a4f43403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8945f9af-c0a2-499c-ab07-2a6491afb8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8945f9af-c0a2-499c-ab07-2a6491afb8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca', 'volume_name': 'volume-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cffff4c1-0441-49f5-83b5-9ab2d20a8171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cffff4c1-0441-49f5-83b5-9ab2d20a8171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:31:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ad0bb8-0927-4913-98c8-5e49bcde1321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:31:54 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Volume 2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca', 'volume_size': 1} Sep 10 18:31:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-837760e1-bc7b-4d8e-84c0-2822f243bdfb tempest-VolumesActionsTest-229338527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.649s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:04 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-837760e1-bc7b-4d8e-84c0-2822f243bdfb tempest-VolumesActionsTest-229338527 None] Uploaded volume to glance image-id: df86fab8-d015-4594-a2dc-faf683ea0cac. {{(pid=87842) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 10 18:32:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-39ece10d-2861-4d2a-bb0f-0b4f380d55dd req-64f49cba-7ce3-4ead-8e4d-d44940b2aa3f tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 25.685s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-39ece10d-2861-4d2a-bb0f-0b4f380d55dd req-64f49cba-7ce3-4ead-8e4d-d44940b2aa3f tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.525s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:04 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-855224921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafe9ae4-b63b-4978-956b-cb11fe3bc600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d6eb6d1af848528574be0115592880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:41Z,use_quota=True,user_id='c8df80285f684acab13028c90b540a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:32:04 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Creating volume aafe9ae4-b63b-4978-956b-cb11fe3bc600 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:32:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:04 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:04 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:04 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:32:04 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:32:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:04 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-837760e1-bc7b-4d8e-84c0-2822f243bdfb tempest-VolumesActionsTest-229338527 None] Copy volume to image completed successfully. Sep 10 18:32:04 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600 1073741824 Sep 10 18:32:04 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:04 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-39ece10d-2861-4d2a-bb0f-0b4f380d55dd req-64f49cba-7ce3-4ead-8e4d-d44940b2aa3f tempest-TestServerVolumeAttachmentScenario-1688598671 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ef18ddb-1281-45ef-805b-e4d2b8ae1175', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:32:04 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-39ece10d-2861-4d2a-bb0f-0b4f380d55dd req-64f49cba-7ce3-4ead-8e4d-d44940b2aa3f tempest-TestServerVolumeAttachmentScenario-1688598671 None] attachment_update completed successfully. Sep 10 18:32:04 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600 1073741824" returned: 0 in 0.467s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:04 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600 Sep 10 18:32:04 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:05 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600" returned: 0 in 0.247s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.441s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1892255321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f03f6d275641dbba61ecb827ebabe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:31:55Z,use_quota=True,user_id='d6e88b0921584b1ea66febe8c1097b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Creating volume 2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:32:05 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7daf2e4c-1423-497d-beaa-f182c790818e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:05 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca 1073741824 Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d77447f6-607f-49f8-9750-662975881ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:05 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:05 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Volume volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600 (aafe9ae4-b63b-4978-956b-cb11fe3bc600): created successfully Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d77447f6-607f-49f8-9750-662975881ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Flow 'volume_create_manager' (11ba1b66-636e-48b8-acad-9ffef9fbd25b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:05 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d455894c-86c8-406d-8ea7-d56d698e417d tempest-CinderUnicodeTest-1028312751 None] Created volume successfully. Sep 10 18:32:05 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca 1073741824" returned: 0 in 0.547s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4ef69ff7-7e08-4567-831e-31c26891ba4a tempest-CinderUnicodeTest-1028312751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:05 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca Sep 10 18:32:05 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:06 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca" returned: 0 in 0.309s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:06 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:32:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4ef69ff7-7e08-4567-831e-31c26891ba4a tempest-CinderUnicodeTest-1028312751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.342s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:06 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-4ef69ff7-7e08-4567-831e-31c26891ba4a tempest-CinderUnicodeTest-1028312751 None] Creating offline snapshot 1b7126a0-e1b7-41db-9790-961961c6bc3a of volume aafe9ae4-b63b-4978-956b-cb11fe3bc600 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:32:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ad0bb8-0927-4913-98c8-5e49bcde1321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68099b9f-aa99-4e3f-90ff-71dd6ab90758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:06 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[156cafef-77f3-4605-9878-dabf68c0ff92]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ef69ff7-7e08-4567-831e-31c26891ba4a tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:06 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Volume volume-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca (2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca): created successfully Sep 10 18:32:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68099b9f-aa99-4e3f-90ff-71dd6ab90758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Flow 'volume_create_manager' (38ca7f9d-764a-4108-a96c-48b2fed8ea3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:06 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-aa3841f6-f279-43ab-a9b4-e8a1db549d1c tempest-VolumesTransfersTest-840055815 None] Created volume successfully. Sep 10 18:32:06 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600 Sep 10 18:32:06 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:06 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-15b64be4-7d23-47b2-bce9-86d40ee7d6b3 req-c7cb8da9-6a01-4cbe-a12b-01004dbe9e23 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Terminate volume connection completed successfully. Sep 10 18:32:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-15b64be4-7d23-47b2-bce9-86d40ee7d6b3 req-c7cb8da9-6a01-4cbe-a12b-01004dbe9e23 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Deleting attachment 6ef18ddb-1281-45ef-805b-e4d2b8ae1175. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:32:06 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ef69ff7-7e08-4567-831e-31c26891ba4a tempest-CinderUnicodeTest-1028312751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600" returned: 0 in 0.441s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ef69ff7-7e08-4567-831e-31c26891ba4a tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:06 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a 1G Sep 10 18:32:06 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:06 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ef69ff7-7e08-4567-831e-31c26891ba4a tempest-CinderUnicodeTest-1028312751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a 1G" returned: 0 in 0.435s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ef69ff7-7e08-4567-831e-31c26891ba4a tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:07 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a Sep 10 18:32:07 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:07 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-297654b0-df18-411d-81ac-34f0f3e28281 tempest-VolumesTransfersTest-1691897088 None] Transfer volume completed successfully. Sep 10 18:32:07 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ef69ff7-7e08-4567-831e-31c26891ba4a tempest-CinderUnicodeTest-1028312751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a" returned: 0 in 0.356s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:07 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-4ef69ff7-7e08-4567-831e-31c26891ba4a tempest-CinderUnicodeTest-1028312751 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a is being set with open permissions: ugo+rw Sep 10 18:32:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ef69ff7-7e08-4567-831e-31c26891ba4a tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:07 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a Sep 10 18:32:07 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:07 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ef69ff7-7e08-4567-831e-31c26891ba4a tempest-CinderUnicodeTest-1028312751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a" returned: 0 in 0.284s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ef69ff7-7e08-4567-831e-31c26891ba4a tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:07 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.info Sep 10 18:32:07 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] Acquiring lock "cinder-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] Lock "cinder-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] Acquiring lock "cinder-quobyte-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] Lock "cinder-quobyte-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca" acquired by "delete_volume" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:07 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac609b0-f815-469c-ab53-637ca492e1bd]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:07 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-7a0f1a3b-c4b0-4753-a9ba-b8f52a15e651 req-2e9a492e-a95e-44d3-9993-295087b21864 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Terminate volume connection completed successfully. Sep 10 18:32:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-7a0f1a3b-c4b0-4753-a9ba-b8f52a15e651 req-2e9a492e-a95e-44d3-9993-295087b21864 tempest-TestServerVolumeAttachmentScenario-1688598671 None] Deleting attachment 308bfab6-75a3-4cb7-925a-6a48f31bd56e. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:32:07 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ef69ff7-7e08-4567-831e-31c26891ba4a tempest-CinderUnicodeTest-1028312751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.info" returned: 0 in 0.307s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:07 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-4ef69ff7-7e08-4567-831e-31c26891ba4a tempest-CinderUnicodeTest-1028312751 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.info is being set with open permissions: ugo+rw Sep 10 18:32:07 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca Sep 10 18:32:07 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ef69ff7-7e08-4567-831e-31c26891ba4a tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:07 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.info Sep 10 18:32:07 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:08 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca" returned: 0 in 0.391s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:08 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ef69ff7-7e08-4567-831e-31c26891ba4a tempest-CinderUnicodeTest-1028312751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.info" returned: 0 in 0.278s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4ef69ff7-7e08-4567-831e-31c26891ba4a tempest-CinderUnicodeTest-1028312751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.200s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.957s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:08 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca Sep 10 18:32:08 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:08 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[604adf43-f446-430f-9523-0cc1ec4a5685]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:08 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4ef69ff7-7e08-4567-831e-31c26891ba4a tempest-CinderUnicodeTest-1028312751 None] Create snapshot completed successfully Sep 10 18:32:08 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 Sep 10 18:32:08 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:08 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca" returned: 0 in 0.264s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] Lock "cinder-quobyte-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca" released by "delete_volume" :: held 0.720s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:08 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] Created reservations ['34b110a2-d7ef-4ff9-84eb-17616f42ada8', 'da18fc27-60ec-403f-a49d-e510974e5dd7', 'cd21f6d6-fbd4-4945-87fd-90086c65eb8b', '60526d8d-cf10-4e9e-aece-0f77663d455b'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:32:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:08 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83" returned: 0 in 0.408s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:08 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:32:08 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:08 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d1e1a3-9e25-443b-b631-ffae57d5cf31]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:08 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 Sep 10 18:32:08 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:09 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] Acquiring lock "cinder-1b7126a0-e1b7-41db-9790-961961c6bc3a-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.365s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:09 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:32:09 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] Deleted volume successfully. Sep 10 18:32:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] Lock "cinder-1b7126a0-e1b7-41db-9790-961961c6bc3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] Acquiring lock "cinder-quobyte-aafe9ae4-b63b-4978-956b-cb11fe3bc600" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-66825200-fdc8-419f-938e-5f8fb9d3a2a8 tempest-VolumesTransfersTest-1398830345 None] Lock "cinder-2360f91b-9ab6-4c8b-a31c-03e1fcdfb3ca-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] Lock "cinder-quobyte-aafe9ae4-b63b-4978-956b-cb11fe3bc600" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] Acquiring lock "cinder-quobyte-1b7126a0-e1b7-41db-9790-961961c6bc3a" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] Lock "cinder-quobyte-1b7126a0-e1b7-41db-9790-961961c6bc3a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] Deleting offline snapshot 1b7126a0-e1b7-41db-9790-961961c6bc3a of volume aafe9ae4-b63b-4978-956b-cb11fe3bc600 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:32:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] snapshot_file for this snap is: volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:32:09 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2312a7a8-97ba-436d-8269-679e8d1b524d]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:09 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a Sep 10 18:32:09 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:09 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83" returned: 0 in 0.725s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 /opt/stack/data/cinder/conversion/ddd8c07d-24e4-4114-be86-837e51ae7d83.temp_image.1c145656-208e-478f-9df9-5d14e3bfdc9e622eoqs1.img {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:09 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 /opt/stack/data/cinder/conversion/ddd8c07d-24e4-4114-be86-837e51ae7d83.temp_image.1c145656-208e-478f-9df9-5d14e3bfdc9e622eoqs1.img Sep 10 18:32:09 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:09 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a" returned: 0 in 0.733s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:32:09 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[35507431-1922-425f-91cb-3e2d167c3125]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:10 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:32:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Flow 'volume_create_manager' (aa5fda2b-93a8-4fa7-a2c0-ed93dcb3f32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605dfcde-5591-47cc-848d-1227df53629f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605dfcde-5591-47cc-848d-1227df53629f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1102718167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d83fd4-7b3a-413e-9cea-0706a4442425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f03f6d275641dbba61ecb827ebabe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:10Z,use_quota=True,user_id='d6e88b0921584b1ea66febe8c1097b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:10 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600 Sep 10 18:32:10 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb057dbe-6126-49e4-96b3-12bebbcd45c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb057dbe-6126-49e4-96b3-12bebbcd45c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d36706-3172-4b18-9978-71bbd481d274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d36706-3172-4b18-9978-71bbd481d274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d83fd4-7b3a-413e-9cea-0706a4442425', 'volume_name': 'volume-47d83fd4-7b3a-413e-9cea-0706a4442425', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e1b8dc-8533-4ab0-bde8-34a1b69f0b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e1b8dc-8533-4ab0-bde8-34a1b69f0b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4950227-3787-49a3-ae74-a07748d88d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:10 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Volume 47d83fd4-7b3a-413e-9cea-0706a4442425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d83fd4-7b3a-413e-9cea-0706a4442425', 'volume_size': 1} Sep 10 18:32:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:10 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600" returned: 0 in 0.859s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:10 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a Sep 10 18:32:10 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:11 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a" returned: 0 in 0.969s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:11 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a Sep 10 18:32:11 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:12 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600.1b7126a0-e1b7-41db-9790-961961c6bc3a" returned: 0 in 0.749s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] Lock "cinder-quobyte-1b7126a0-e1b7-41db-9790-961961c6bc3a" released by "_delete_snapshot" :: held 3.582s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] Lock "cinder-quobyte-aafe9ae4-b63b-4978-956b-cb11fe3bc600" released by "delete_snapshot" :: held 3.641s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:13 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] Created reservations ['23878a9e-83a4-4be0-9f73-d5215dd8b78d', '55fc1eea-a233-41ab-a6c5-a70fb792de27', '33c0018a-1bfb-4ca4-b14a-18d5ad8b535d', 'fe9de766-75ad-4227-a715-7c60de08e69f'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:32:13 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] Delete snapshot completed successfully. Sep 10 18:32:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0a2eabcf-15c6-489c-81af-b4cf090609f0 tempest-CinderUnicodeTest-1028312751 None] Lock "cinder-1b7126a0-e1b7-41db-9790-961961c6bc3a-delete_snapshot" released by "delete_snapshot" :: held 4.133s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] Acquiring lock "cinder-aafe9ae4-b63b-4978-956b-cb11fe3bc600-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] Lock "cinder-aafe9ae4-b63b-4978-956b-cb11fe3bc600-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] Acquiring lock "cinder-quobyte-aafe9ae4-b63b-4978-956b-cb11fe3bc600" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] Lock "cinder-quobyte-aafe9ae4-b63b-4978-956b-cb11fe3bc600" acquired by "delete_volume" :: waited 0.044s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:14 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6314a4-1911-4a21-8959-522d534f3d6d]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:14 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600 Sep 10 18:32:14 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:14 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600" returned: 0 in 0.742s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:14 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600 Sep 10 18:32:14 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:15 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 /opt/stack/data/cinder/conversion/ddd8c07d-24e4-4114-be86-837e51ae7d83.temp_image.1c145656-208e-478f-9df9-5d14e3bfdc9e622eoqs1.img" returned: 0 in 5.743s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f28d2d1-c45e-49bb-abd0-592c54f56f2d]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:15 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-aafe9ae4-b63b-4978-956b-cb11fe3bc600" returned: 0 in 0.370s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] Lock "cinder-quobyte-aafe9ae4-b63b-4978-956b-cb11fe3bc600" released by "delete_volume" :: held 1.302s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:15 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 Sep 10 18:32:15 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] Created reservations ['f36ce2b6-8172-4044-96ce-ca8871640a03', 'df909a64-abcd-4cfa-8bbc-5477a6423730', 'c6ae4b86-d067-4dc5-8d6d-b205eaf827c7', '4d6a17f6-141d-4c42-94ca-f62126823c52'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:15 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:32:15 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:15 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.301s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:32:15 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] Deleted volume successfully. Sep 10 18:32:15 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83" returned: 0 in 0.585s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] Image conversion details: src /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/conversion/ddd8c07d-24e4-4114-be86-837e51ae7d83.temp_image.1c145656-208e-478f-9df9-5d14e3bfdc9e622eoqs1.img {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:32:15 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] Converted 1024.00 MB image at 178.17 MB/s Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-812d54fa-63b8-466d-859b-4abcb98ddcd3 tempest-CinderUnicodeTest-1028312751 None] Lock "cinder-aafe9ae4-b63b-4978-956b-cb11fe3bc600-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] 1c145656-208e-478f-9df9-5d14e3bfdc9e was raw, converting to qcow2 {{(pid=87842) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf2ef1b-545a-4e9c-a93e-1920a98712af]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ddd8c07d-24e4-4114-be86-837e51ae7d83.temp_image.1c145656-208e-478f-9df9-5d14e3bfdc9e622eoqs1.img {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:15 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ddd8c07d-24e4-4114-be86-837e51ae7d83.temp_image.1c145656-208e-478f-9df9-5d14e3bfdc9e622eoqs1.img Sep 10 18:32:15 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:16 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ddd8c07d-24e4-4114-be86-837e51ae7d83.temp_image.1c145656-208e-478f-9df9-5d14e3bfdc9e622eoqs1.img" returned: 0 in 0.349s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ddd8c07d-24e4-4114-be86-837e51ae7d83.temp_image.1c145656-208e-478f-9df9-5d14e3bfdc9e622eoqs1.img {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] Acquiring lock "cinder-cdcea5b3-0a97-4742-b628-89a3745cc604-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] Lock "cinder-cdcea5b3-0a97-4742-b628-89a3745cc604-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:16 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ddd8c07d-24e4-4114-be86-837e51ae7d83.temp_image.1c145656-208e-478f-9df9-5d14e3bfdc9e622eoqs1.img Sep 10 18:32:16 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] Acquiring lock "cinder-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "cinder-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] Acquiring lock "cinder-quobyte-cdcea5b3-0a97-4742-b628-89a3745cc604" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] Lock "cinder-quobyte-cdcea5b3-0a97-4742-b628-89a3745cc604" acquired by "delete_volume" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] Acquiring lock "cinder-quobyte-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "cinder-quobyte-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd" acquired by "delete_volume" :: waited 0.014s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4650e2-c8da-463e-b27f-5f37fe8748e9]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cdcea5b3-0a97-4742-b628-89a3745cc604 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f40c7de-6415-4e61-bef4-7cba7a75fe75]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:16 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cdcea5b3-0a97-4742-b628-89a3745cc604 Sep 10 18:32:16 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:16 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd Sep 10 18:32:16 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:16 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ddd8c07d-24e4-4114-be86-837e51ae7d83.temp_image.1c145656-208e-478f-9df9-5d14e3bfdc9e622eoqs1.img" returned: 1 in 0.395s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ddd8c07d-24e4-4114-be86-837e51ae7d83.temp_image.1c145656-208e-478f-9df9-5d14e3bfdc9e622eoqs1.img' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ddd8c07d-24e4-4114-be86-837e51ae7d83.temp_image.1c145656-208e-478f-9df9-5d14e3bfdc9e622eoqs1.img /opt/stack/data/cinder/conversion/vol_upload__le3iba1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:16 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ddd8c07d-24e4-4114-be86-837e51ae7d83.temp_image.1c145656-208e-478f-9df9-5d14e3bfdc9e622eoqs1.img /opt/stack/data/cinder/conversion/vol_upload__le3iba1 Sep 10 18:32:16 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:16 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cdcea5b3-0a97-4742-b628-89a3745cc604" returned: 0 in 0.367s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cdcea5b3-0a97-4742-b628-89a3745cc604 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:16 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cdcea5b3-0a97-4742-b628-89a3745cc604 Sep 10 18:32:16 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:16 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd" returned: 0 in 0.393s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:16 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ddd8c07d-24e4-4114-be86-837e51ae7d83.temp_image.1c145656-208e-478f-9df9-5d14e3bfdc9e622eoqs1.img /opt/stack/data/cinder/conversion/vol_upload__le3iba1" returned: 0 in 0.276s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] Image conversion details: src /opt/stack/data/cinder/conversion/ddd8c07d-24e4-4114-be86-837e51ae7d83.temp_image.1c145656-208e-478f-9df9-5d14e3bfdc9e622eoqs1.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload__le3iba1 {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:32:16 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb216264-98cf-4694-81ef-0671b3431cf3]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__le3iba1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:16 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd Sep 10 18:32:16 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:16 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__le3iba1 Sep 10 18:32:16 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:17 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cdcea5b3-0a97-4742-b628-89a3745cc604" returned: 0 in 0.262s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] Lock "cinder-quobyte-cdcea5b3-0a97-4742-b628-89a3745cc604" released by "delete_volume" :: held 0.685s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:17 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd" returned: 0 in 0.250s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "cinder-quobyte-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd" released by "delete_volume" :: held 0.690s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] Created reservations ['7ee999a3-b82c-40a6-87bb-506d6783d892', '0ef5ead8-e0db-487b-abba-4876f5202a2c', '85c93f0b-a153-404e-8eba-e0fc959b8bf4', 'f6e202e4-3cdd-46f7-ad2c-93f27e579402'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] Created reservations ['84607003-5e10-4085-800a-c25950670cb7', 'e0c5221e-8610-49c2-970b-8c61bd2ec1c7', '12f277ca-4546-4a71-b5c2-49c4cf69cc2a', '80cae0e3-d75c-4650-8ca8-d3caedb95bf0'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:32:17 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__le3iba1" returned: 0 in 0.353s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:17 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:17 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:17 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:32:17 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] Acquiring lock "cinder-fdb3fc2a-ea43-4281-b1a3-7234f51922ba-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "cinder-fdb3fc2a-ea43-4281-b1a3-7234f51922ba-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:17 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.353s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:32:17 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] Deleted volume successfully. Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ede6dc4e-58cd-48ef-be6b-d1803e35946a tempest-CinderUnicodeTest-1028312751 None] Lock "cinder-cdcea5b3-0a97-4742-b628-89a3745cc604-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:17 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.393s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] Acquiring lock "cinder-quobyte-fdb3fc2a-ea43-4281-b1a3-7234f51922ba" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:17 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] Deleted volume successfully. Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "cinder-quobyte-fdb3fc2a-ea43-4281-b1a3-7234f51922ba" acquired by "delete_volume" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-cc8e58bc-d007-4cd6-bae2-dd025991578d tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "cinder-51cd6a82-d77e-471a-bb90-4f94d0ef9ecd-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eca810d-81eb-46b9-82e9-03ba00452d04]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fdb3fc2a-ea43-4281-b1a3-7234f51922ba {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:17 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fdb3fc2a-ea43-4281-b1a3-7234f51922ba Sep 10 18:32:17 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:18 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fdb3fc2a-ea43-4281-b1a3-7234f51922ba" returned: 0 in 0.413s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fdb3fc2a-ea43-4281-b1a3-7234f51922ba {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:18 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fdb3fc2a-ea43-4281-b1a3-7234f51922ba Sep 10 18:32:18 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:18 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fdb3fc2a-ea43-4281-b1a3-7234f51922ba" returned: 0 in 0.291s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "cinder-quobyte-fdb3fc2a-ea43-4281-b1a3-7234f51922ba" released by "delete_volume" :: held 0.760s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:18 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] Created reservations ['a7e82e53-d5ce-4545-a53f-3ee3f04229b2', '35e21691-19c5-433e-ad61-7f489cb5fbff', 'ad49e600-4fc1-4856-ab4d-df5c6d8bb7fb', '11371d5c-d75e-460b-99b3-be3322b90054'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:32:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.784s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] Uploaded volume to glance image-id: 1c145656-208e-478f-9df9-5d14e3bfdc9e. {{(pid=87842) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.749s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1102718167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d83fd4-7b3a-413e-9cea-0706a4442425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f03f6d275641dbba61ecb827ebabe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:10Z,use_quota=True,user_id='d6e88b0921584b1ea66febe8c1097b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Creating volume 47d83fd4-7b3a-413e-9cea-0706a4442425 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:32:19 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:32:19 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:32:19 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47d83fd4-7b3a-413e-9cea-0706a4442425 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:19 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47d83fd4-7b3a-413e-9cea-0706a4442425 1073741824 Sep 10 18:32:19 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:19 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-8339b116-59be-4801-b04a-4ffe8f58c266 tempest-VolumesActionsTest-229338527 None] Copy volume to image completed successfully. Sep 10 18:32:19 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.303s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:32:19 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] Deleted volume successfully. Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a7f3a063-40cb-43f2-bbb8-bfc8a75c6d8b tempest-TestServerVolumeAttachmentScenario-1688598671 None] Lock "cinder-fdb3fc2a-ea43-4281-b1a3-7234f51922ba-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:19 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47d83fd4-7b3a-413e-9cea-0706a4442425 1073741824" returned: 0 in 0.474s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47d83fd4-7b3a-413e-9cea-0706a4442425 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:19 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47d83fd4-7b3a-413e-9cea-0706a4442425 Sep 10 18:32:19 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:19 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47d83fd4-7b3a-413e-9cea-0706a4442425" returned: 0 in 0.272s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4950227-3787-49a3-ae74-a07748d88d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d83fd4-7b3a-413e-9cea-0706a4442425', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3ef11d-9d7d-4430-a48b-671d6efafb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:19 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Volume volume-47d83fd4-7b3a-413e-9cea-0706a4442425 (47d83fd4-7b3a-413e-9cea-0706a4442425): created successfully Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3ef11d-9d7d-4430-a48b-671d6efafb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Flow 'volume_create_manager' (aa5fda2b-93a8-4fa7-a2c0-ed93dcb3f32f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:19 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-33472b64-fbc1-497f-88b5-182eb4b06c2c tempest-VolumesTransfersTest-840055815 None] Created volume successfully. Sep 10 18:32:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] Acquiring lock "cinder-ddd8c07d-24e4-4114-be86-837e51ae7d83-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] Lock "cinder-ddd8c07d-24e4-4114-be86-837e51ae7d83-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] Acquiring lock "cinder-quobyte-ddd8c07d-24e4-4114-be86-837e51ae7d83" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] Lock "cinder-quobyte-ddd8c07d-24e4-4114-be86-837e51ae7d83" acquired by "delete_volume" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:21 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f35b6d-2e7b-45e9-87b7-42b82ccfa1b0]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:21 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 Sep 10 18:32:21 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] Acquiring lock "cinder-47d83fd4-7b3a-413e-9cea-0706a4442425-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:21 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83" returned: 0 in 0.465s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] Lock "cinder-47d83fd4-7b3a-413e-9cea-0706a4442425-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:21 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83 Sep 10 18:32:21 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] Acquiring lock "cinder-quobyte-47d83fd4-7b3a-413e-9cea-0706a4442425" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] Lock "cinder-quobyte-47d83fd4-7b3a-413e-9cea-0706a4442425" acquired by "delete_volume" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:21 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[699e70fe-5ad8-4b11-99e4-bc5c3cc9831b]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47d83fd4-7b3a-413e-9cea-0706a4442425 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:21 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47d83fd4-7b3a-413e-9cea-0706a4442425 Sep 10 18:32:21 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:21 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ddd8c07d-24e4-4114-be86-837e51ae7d83" returned: 0 in 0.351s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] Lock "cinder-quobyte-ddd8c07d-24e4-4114-be86-837e51ae7d83" released by "delete_volume" :: held 0.878s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:21 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] Created reservations ['d3796882-8e4b-4776-971d-9a34a225ccae', '71451705-e565-4093-bd09-550835fb7ba2', '2faa8e99-10ba-4983-9aeb-7a6735680a8e', '257d9add-cbe5-45d4-951f-79f6a5e2ceb5'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:22 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:32:22 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:22 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47d83fd4-7b3a-413e-9cea-0706a4442425" returned: 0 in 0.494s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47d83fd4-7b3a-413e-9cea-0706a4442425 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:22 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47d83fd4-7b3a-413e-9cea-0706a4442425 Sep 10 18:32:22 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:22 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.339s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:32:22 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] Deleted volume successfully. Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7de32abb-e45a-4490-ad07-abba79502e92 tempest-VolumesActionsTest-229338527 None] Lock "cinder-ddd8c07d-24e4-4114-be86-837e51ae7d83-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:22 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47d83fd4-7b3a-413e-9cea-0706a4442425" returned: 0 in 0.391s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] Lock "cinder-quobyte-47d83fd4-7b3a-413e-9cea-0706a4442425" released by "delete_volume" :: held 0.946s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] Created reservations ['eb6bd3f6-e15d-4b70-a023-842f04bb21f5', '69c436f3-c888-4212-a12c-8d713956822d', 'd8394345-fa81-432f-ab6e-4387e0b9a197', 'b4bd7b1b-24b1-4bd7-bdb9-26151f1ee5cc'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:22 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:32:22 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:23 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.289s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:23 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:32:23 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] Deleted volume successfully. Sep 10 18:32:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-04f2c4fa-6206-4948-a499-dd61269efbc6 tempest-VolumesTransfersTest-1398830345 None] Lock "cinder-47d83fd4-7b3a-413e-9cea-0706a4442425-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Flow 'volume_create_manager' (4c9a2257-e561-43e5-b1c0-7bd1bc3bd75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04944e8-36e8-4d06-82ba-9ae8eb31878b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04944e8-36e8-4d06-82ba-9ae8eb31878b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1102547784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ab8373-f71c-4d2c-a37f-6267bd69e8c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bfc00a63d047858a1c85f123bb6ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:29Z,use_quota=True,user_id='4f61ef74044a42eb90f7593e14df7fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d849d928-6c83-4aa5-8876-51925fb5c3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d849d928-6c83-4aa5-8876-51925fb5c3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55987790-311e-4ac3-8d6b-48ed69d964d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55987790-311e-4ac3-8d6b-48ed69d964d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1ab8373-f71c-4d2c-a37f-6267bd69e8c2', 'volume_name': 'volume-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68dc288-6e14-48d5-af73-84d55f559a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68dc288-6e14-48d5-af73-84d55f559a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072ecb05-b832-4626-a303-d5e050ea74fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:28 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Volume e1ab8373-f71c-4d2c-a37f-6267bd69e8c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2', 'volume_size': 1} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1102547784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ab8373-f71c-4d2c-a37f-6267bd69e8c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bfc00a63d047858a1c85f123bb6ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:29Z,use_quota=True,user_id='4f61ef74044a42eb90f7593e14df7fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Creating volume e1ab8373-f71c-4d2c-a37f-6267bd69e8c2 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:32:28 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:32:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:28 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2 1073741824 Sep 10 18:32:28 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:29 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:32:29 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:29 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.342s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 28 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:32:29 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2 1073741824" returned: 0 in 0.693s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:29 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2 Sep 10 18:32:29 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:29 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2" returned: 0 in 0.269s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072ecb05-b832-4626-a303-d5e050ea74fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (844abb44-8814-4a93-9b9d-46137baa13e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:29 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Volume volume-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2 (e1ab8373-f71c-4d2c-a37f-6267bd69e8c2): created successfully Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (844abb44-8814-4a93-9b9d-46137baa13e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Flow 'volume_create_manager' (4c9a2257-e561-43e5-b1c0-7bd1bc3bd75c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:29 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-fca76704-d70c-4527-8a7a-dabb3c291fd1 tempest-ProjectReaderTests-316387561 None] Created volume successfully. Sep 10 18:32:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] Acquiring lock "cinder-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] Lock "cinder-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] Acquiring lock "cinder-quobyte-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] Lock "cinder-quobyte-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2" acquired by "delete_volume" :: waited 0.024s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:31 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c742098-02c0-4b03-a863-2eb150566450]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:31 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2 Sep 10 18:32:31 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:31 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2" returned: 0 in 0.402s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:31 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2 Sep 10 18:32:31 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:31 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2" returned: 0 in 0.290s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:31 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] Lock "cinder-quobyte-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2" released by "delete_volume" :: held 0.751s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] Created reservations ['b69e36ee-7d47-4233-875a-d8282fdecf68', 'fa85b34c-2984-4861-8939-b74575951e63', 'ede17364-a6ce-48a8-bb7d-f77d61da2149', '641d4b04-6f34-4a4a-a852-00b6a1df6ca8'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:32 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:32:32 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:32 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.353s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:32:32 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] Deleted volume successfully. Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-861b4205-f044-4ffd-b872-f1333bf65f48 tempest-ProjectReaderTests-316387561 None] Lock "cinder-e1ab8373-f71c-4d2c-a37f-6267bd69e8c2-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Flow 'volume_create_manager' (c48e9ab6-7b93-4a17-91b5-c1d8bb235a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1624af68-847f-4a76-8ee9-29f9298b97d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1624af68-847f-4a76-8ee9-29f9298b97d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1689206778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fe974a-8085-49f4-b511-57f3f170214f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a905b59090044a25a152ca973b3252ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:33Z,use_quota=True,user_id='e83acce607954136882c96785dfaefa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3936a94-363d-4269-9e8d-4e8d651376e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3936a94-363d-4269-9e8d-4e8d651376e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455fe16b-6899-44fc-ad04-e6f75b502cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455fe16b-6899-44fc-ad04-e6f75b502cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81fe974a-8085-49f4-b511-57f3f170214f', 'volume_name': 'volume-81fe974a-8085-49f4-b511-57f3f170214f', 'volume_size': 2}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77fd30c4-b58e-43e3-a27a-c9c8fa65a889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77fd30c4-b58e-43e3-a27a-c9c8fa65a889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5e52b7-5371-4a48-bf3b-667a7ebe7fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:32 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Volume 81fe974a-8085-49f4-b511-57f3f170214f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81fe974a-8085-49f4-b511-57f3f170214f', 'volume_size': 2} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1689206778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fe974a-8085-49f4-b511-57f3f170214f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a905b59090044a25a152ca973b3252ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:33Z,use_quota=True,user_id='e83acce607954136882c96785dfaefa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Creating volume 81fe974a-8085-49f4-b511-57f3f170214f {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:32:32 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:32:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-81fe974a-8085-49f4-b511-57f3f170214f 2147483648 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:32 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-81fe974a-8085-49f4-b511-57f3f170214f 2147483648 Sep 10 18:32:32 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Flow 'volume_create_manager' (534d3982-577c-4c26-9333-1d6ff748f1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9201ec0-3213-4f70-92d5-ad11b2f40ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9201ec0-3213-4f70-92d5-ad11b2f40ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-895937534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5fb5368-0b2d-445b-9735-95c93228b96c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bfc00a63d047858a1c85f123bb6ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:33Z,use_quota=True,user_id='4f61ef74044a42eb90f7593e14df7fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cafc254-bc88-425e-a647-9c4201f54efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cafc254-bc88-425e-a647-9c4201f54efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea055da-53b4-495d-a1da-3776987dcddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea055da-53b4-495d-a1da-3776987dcddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5fb5368-0b2d-445b-9735-95c93228b96c', 'volume_name': 'volume-b5fb5368-0b2d-445b-9735-95c93228b96c', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77999bf0-0a74-440e-aa61-76b626bba29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77999bf0-0a74-440e-aa61-76b626bba29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434238c6-cde6-4752-9ee0-3267c42dc6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:33 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Volume b5fb5368-0b2d-445b-9735-95c93228b96c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5fb5368-0b2d-445b-9735-95c93228b96c', 'volume_size': 1} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:33 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-81fe974a-8085-49f4-b511-57f3f170214f 2147483648" returned: 0 in 0.763s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-81fe974a-8085-49f4-b511-57f3f170214f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:33 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-81fe974a-8085-49f4-b511-57f3f170214f Sep 10 18:32:33 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:33 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-81fe974a-8085-49f4-b511-57f3f170214f" returned: 0 in 0.282s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-895937534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5fb5368-0b2d-445b-9735-95c93228b96c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bfc00a63d047858a1c85f123bb6ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:33Z,use_quota=True,user_id='4f61ef74044a42eb90f7593e14df7fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Creating volume b5fb5368-0b2d-445b-9735-95c93228b96c {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:32:33 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b5fb5368-0b2d-445b-9735-95c93228b96c 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5e52b7-5371-4a48-bf3b-667a7ebe7fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81fe974a-8085-49f4-b511-57f3f170214f', 'volume_size': 2}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9ca584-c464-405d-8da8-05274d6d937e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:33 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b5fb5368-0b2d-445b-9735-95c93228b96c 1073741824 Sep 10 18:32:33 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:33 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Volume volume-81fe974a-8085-49f4-b511-57f3f170214f (81fe974a-8085-49f4-b511-57f3f170214f): created successfully Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9ca584-c464-405d-8da8-05274d6d937e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Flow 'volume_create_manager' (c48e9ab6-7b93-4a17-91b5-c1d8bb235a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:33 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-61c0aa72-4009-4a68-8d9f-fc38d694f1e4 tempest-VolumesCloneNegativeTest-1412314596 None] Created volume successfully. Sep 10 18:32:34 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b5fb5368-0b2d-445b-9735-95c93228b96c 1073741824" returned: 0 in 0.547s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b5fb5368-0b2d-445b-9735-95c93228b96c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:34 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b5fb5368-0b2d-445b-9735-95c93228b96c Sep 10 18:32:34 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:34 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b5fb5368-0b2d-445b-9735-95c93228b96c" returned: 0 in 0.352s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:32:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] Acquiring lock "cinder-81fe974a-8085-49f4-b511-57f3f170214f-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434238c6-cde6-4752-9ee0-3267c42dc6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5fb5368-0b2d-445b-9735-95c93228b96c', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6e5929-cb9e-4ba8-bbd4-53781b30109e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] Lock "cinder-81fe974a-8085-49f4-b511-57f3f170214f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:34 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Volume volume-b5fb5368-0b2d-445b-9735-95c93228b96c (b5fb5368-0b2d-445b-9735-95c93228b96c): created successfully Sep 10 18:32:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6e5929-cb9e-4ba8-bbd4-53781b30109e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Flow 'volume_create_manager' (534d3982-577c-4c26-9333-1d6ff748f1cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] Acquiring lock "cinder-quobyte-81fe974a-8085-49f4-b511-57f3f170214f" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:34 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-74b3d82c-3dcb-41ea-a294-85b0a7c2b26d tempest-ProjectReaderTests-316387561 None] Created volume successfully. Sep 10 18:32:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] Lock "cinder-quobyte-81fe974a-8085-49f4-b511-57f3f170214f" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba44e3c-d338-413f-b652-853ad2518dd0]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-81fe974a-8085-49f4-b511-57f3f170214f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:35 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-81fe974a-8085-49f4-b511-57f3f170214f Sep 10 18:32:35 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] Acquiring lock "cinder-b5fb5368-0b2d-445b-9735-95c93228b96c-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] Lock "cinder-b5fb5368-0b2d-445b-9735-95c93228b96c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] Acquiring lock "cinder-quobyte-b5fb5368-0b2d-445b-9735-95c93228b96c" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] Lock "cinder-quobyte-b5fb5368-0b2d-445b-9735-95c93228b96c" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8838dd-9b4f-4493-88a0-89b63b64d924]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b5fb5368-0b2d-445b-9735-95c93228b96c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:35 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-81fe974a-8085-49f4-b511-57f3f170214f" returned: 0 in 0.530s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-81fe974a-8085-49f4-b511-57f3f170214f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:35 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-81fe974a-8085-49f4-b511-57f3f170214f Sep 10 18:32:35 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:35 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b5fb5368-0b2d-445b-9735-95c93228b96c Sep 10 18:32:35 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Flow 'volume_create_manager' (c03446f7-1107-4784-af3e-308f9f024afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89998843-c275-43a1-82d0-90b01d746a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89998843-c275-43a1-82d0-90b01d746a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1557462274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd39c036-ccdf-4f03-9da1-d039f60c64e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad5f9f817c8476a96a821c0c38b914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:36Z,use_quota=True,user_id='d54d2522cf8b4e239dc1bae2fc956671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2d0831-0af5-4314-9cbd-b9ea3c81a281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2d0831-0af5-4314-9cbd-b9ea3c81a281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a158ff54-3b3d-4d33-8f28-d7b5ae35851b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a158ff54-3b3d-4d33-8f28-d7b5ae35851b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd39c036-ccdf-4f03-9da1-d039f60c64e4', 'volume_name': 'volume-cd39c036-ccdf-4f03-9da1-d039f60c64e4', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac8e0a9-1e05-41a2-910f-a3936011781e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac8e0a9-1e05-41a2-910f-a3936011781e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0bf8176-9d3b-4230-a782-6fa63b4adee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:35 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Volume cd39c036-ccdf-4f03-9da1-d039f60c64e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd39c036-ccdf-4f03-9da1-d039f60c64e4', 'volume_size': 1} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1557462274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd39c036-ccdf-4f03-9da1-d039f60c64e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad5f9f817c8476a96a821c0c38b914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:36Z,use_quota=True,user_id='d54d2522cf8b4e239dc1bae2fc956671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Creating volume cd39c036-ccdf-4f03-9da1-d039f60c64e4 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:32:35 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cd39c036-ccdf-4f03-9da1-d039f60c64e4 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:35 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cd39c036-ccdf-4f03-9da1-d039f60c64e4 1073741824 Sep 10 18:32:35 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:35 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-81fe974a-8085-49f4-b511-57f3f170214f" returned: 0 in 0.338s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:35 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b5fb5368-0b2d-445b-9735-95c93228b96c" returned: 0 in 0.504s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b5fb5368-0b2d-445b-9735-95c93228b96c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] Lock "cinder-quobyte-81fe974a-8085-49f4-b511-57f3f170214f" released by "delete_volume" :: held 0.930s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:35 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b5fb5368-0b2d-445b-9735-95c93228b96c Sep 10 18:32:35 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:35 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] Created reservations ['9d125a08-676e-4dfa-a0bc-5d1144f2e6be', '3301dafe-b0c7-4f7e-88b1-8532ec2bd3aa', '983ca43d-93e1-4cff-9ceb-5c29f7e0361a', 'c555b8a1-3016-45af-9018-cb9cf0ec1532'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:36 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:32:36 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:36 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b5fb5368-0b2d-445b-9735-95c93228b96c" returned: 0 in 0.387s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] Lock "cinder-quobyte-b5fb5368-0b2d-445b-9735-95c93228b96c" released by "delete_volume" :: held 0.963s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] Created reservations ['a41e739c-3fad-4d5d-90dd-040c38014ab1', '822bf8ab-0798-4ea5-962a-fc5cd4e1cb6c', '532e1e0a-d938-4503-80c3-cf81612d6e22', '9d8da31c-69e9-4343-9b7a-5f51464d21e3'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:32:36 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cd39c036-ccdf-4f03-9da1-d039f60c64e4 1073741824" returned: 0 in 0.645s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:36 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.372s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cd39c036-ccdf-4f03-9da1-d039f60c64e4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:36 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:32:36 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:36 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] Deleted volume successfully. Sep 10 18:32:36 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cd39c036-ccdf-4f03-9da1-d039f60c64e4 Sep 10 18:32:36 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dc9c9e01-0308-4cf8-9e94-a1739c584dca tempest-VolumesCloneNegativeTest-1412314596 None] Lock "cinder-81fe974a-8085-49f4-b511-57f3f170214f-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:36 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.329s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:32:36 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] Deleted volume successfully. Sep 10 18:32:36 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cd39c036-ccdf-4f03-9da1-d039f60c64e4" returned: 0 in 0.330s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7d3319e6-349e-4abe-a9f3-5aa27df4443c tempest-ProjectReaderTests-316387561 None] Lock "cinder-b5fb5368-0b2d-445b-9735-95c93228b96c-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0bf8176-9d3b-4230-a782-6fa63b4adee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd39c036-ccdf-4f03-9da1-d039f60c64e4', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd3cda2-1fe8-4338-a7f1-bf8a6ee6f480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:36 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Volume volume-cd39c036-ccdf-4f03-9da1-d039f60c64e4 (cd39c036-ccdf-4f03-9da1-d039f60c64e4): created successfully Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd3cda2-1fe8-4338-a7f1-bf8a6ee6f480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:36 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Flow 'volume_create_manager' (c03446f7-1107-4784-af3e-308f9f024afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:36 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-0f3fff42-c8a6-4ee8-962d-0de1ffd3cecc tempest-VolumesTransfersV355Test-731092411 None] Created volume successfully. Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Flow 'volume_create_manager' (6295a051-5a69-4239-a4be-00d7517fa0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76bdeab-63af-4d4c-a441-9f6016d3b28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76bdeab-63af-4d4c-a441-9f6016d3b28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1788384961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bfc00a63d047858a1c85f123bb6ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:38Z,use_quota=True,user_id='4f61ef74044a42eb90f7593e14df7fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (997b10c4-d974-48d2-a420-180dbc0e44ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (997b10c4-d974-48d2-a420-180dbc0e44ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ef9b76-6f48-40db-9768-4a8b0a4f4c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ef9b76-6f48-40db-9768-4a8b0a4f4c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642', 'volume_name': 'volume-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9eed67-72f1-4158-b7db-973f43f663fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9eed67-72f1-4158-b7db-973f43f663fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8decd2f-3bf1-48f0-9e27-0632cea8c577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:38 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Volume a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642', 'volume_size': 1} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1788384961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bfc00a63d047858a1c85f123bb6ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:38Z,use_quota=True,user_id='4f61ef74044a42eb90f7593e14df7fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Creating volume a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:32:38 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:38 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642 1073741824 Sep 10 18:32:38 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:38 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-60907579-967e-4ae3-b039-3724d5478a69 tempest-VolumesTransfersV355Test-420979308 None] Transfer volume completed successfully. Sep 10 18:32:38 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642 1073741824" returned: 0 in 0.588s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:38 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642 Sep 10 18:32:38 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:39 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642" returned: 0 in 0.366s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:39 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:32:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8decd2f-3bf1-48f0-9e27-0632cea8c577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be26d761-82cf-49a2-9d00-45e7f4a81305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:39 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Volume volume-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642 (a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642): created successfully Sep 10 18:32:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be26d761-82cf-49a2-9d00-45e7f4a81305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Flow 'volume_create_manager' (6295a051-5a69-4239-a4be-00d7517fa0e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:39 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-1c1807d4-c76f-4375-ae28-da17fb27f5ac tempest-ProjectReaderTests-316387561 None] Created volume successfully. Sep 10 18:32:39 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] Acquiring lock "cinder-cd39c036-ccdf-4f03-9da1-d039f60c64e4-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:39 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] Lock "cinder-cd39c036-ccdf-4f03-9da1-d039f60c64e4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:39 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] Acquiring lock "cinder-quobyte-cd39c036-ccdf-4f03-9da1-d039f60c64e4" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:39 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] Lock "cinder-quobyte-cd39c036-ccdf-4f03-9da1-d039f60c64e4" acquired by "delete_volume" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:39 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af4d830-f13c-4239-b443-c67067a0bfc0]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cd39c036-ccdf-4f03-9da1-d039f60c64e4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:39 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cd39c036-ccdf-4f03-9da1-d039f60c64e4 Sep 10 18:32:39 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:40 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cd39c036-ccdf-4f03-9da1-d039f60c64e4" returned: 0 in 0.458s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cd39c036-ccdf-4f03-9da1-d039f60c64e4 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:40 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cd39c036-ccdf-4f03-9da1-d039f60c64e4 Sep 10 18:32:40 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] Acquiring lock "cinder-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] Lock "cinder-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] Acquiring lock "cinder-quobyte-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] Lock "cinder-quobyte-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642" acquired by "delete_volume" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:40 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf727c9-9782-45af-bc74-361b2563360b]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:40 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cd39c036-ccdf-4f03-9da1-d039f60c64e4" returned: 0 in 0.336s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] Lock "cinder-quobyte-cd39c036-ccdf-4f03-9da1-d039f60c64e4" released by "delete_volume" :: held 0.850s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:40 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] Created reservations ['4d803d5c-f109-4d20-bc63-bf3d9931a125', 'b2141b66-9810-4c57-ab4b-56b8e62d267d', '0444602f-5e11-472a-920f-b22291066b31', '0ed904c5-ce8a-4829-bac4-b15c702dda3f'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:32:40 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642 Sep 10 18:32:40 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:40 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:40 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:40 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:32:40 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:40 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642" returned: 0 in 0.516s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:41 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642 Sep 10 18:32:41 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:41 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.571s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:32:41 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] Deleted volume successfully. Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0f519d56-50c0-4528-9d49-ec9405152a31 tempest-VolumesTransfersV355Test-899091421 None] Lock "cinder-cd39c036-ccdf-4f03-9da1-d039f60c64e4-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:41 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642" returned: 0 in 0.397s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] Lock "cinder-quobyte-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642" released by "delete_volume" :: held 0.977s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] Created reservations ['2048037b-54ce-4363-88e1-c7e2c7942840', 'f0d0d7c7-78ca-4d01-b735-286798823006', 'adbbd7da-c9be-4184-b951-0fae8550c582', 'd654a45c-5845-4ba7-8251-f48ac08c5622'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:41 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:32:41 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Flow 'volume_create_manager' (899ded4d-7427-4282-bed2-84bc409c58a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d84dc0-b3c2-4d7d-986d-2a2406e2ee39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d84dc0-b3c2-4d7d-986d-2a2406e2ee39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1657040525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1714b377-7284-4a56-924b-ad4fb647709d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad5f9f817c8476a96a821c0c38b914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:42Z,use_quota=True,user_id='d54d2522cf8b4e239dc1bae2fc956671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e400a038-6359-44f4-9320-e110615b57d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e400a038-6359-44f4-9320-e110615b57d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1fec44e-a8ab-4779-b410-045079560026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:41 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1fec44e-a8ab-4779-b410-045079560026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1714b377-7284-4a56-924b-ad4fb647709d', 'volume_name': 'volume-1714b377-7284-4a56-924b-ad4fb647709d', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1b1e0c-dc39-4826-a39d-a3cfcfe36344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1b1e0c-dc39-4826-a39d-a3cfcfe36344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153764aa-2bb3-4c26-a743-f6498a8f1e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:41 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Volume 1714b377-7284-4a56-924b-ad4fb647709d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1714b377-7284-4a56-924b-ad4fb647709d', 'volume_size': 1} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1657040525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1714b377-7284-4a56-924b-ad4fb647709d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad5f9f817c8476a96a821c0c38b914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:42Z,use_quota=True,user_id='d54d2522cf8b4e239dc1bae2fc956671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Creating volume 1714b377-7284-4a56-924b-ad4fb647709d {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:32:41 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1714b377-7284-4a56-924b-ad4fb647709d 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.351s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:32:41 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] Deleted volume successfully. Sep 10 18:32:41 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1714b377-7284-4a56-924b-ad4fb647709d 1073741824 Sep 10 18:32:41 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ea82d2a5-d8da-4a51-9bd7-6fd249c920bd tempest-ProjectReaderTests-316387561 None] Lock "cinder-a3c6ae5f-9f69-4d4f-a2ef-d80e0422e642-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:42 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1714b377-7284-4a56-924b-ad4fb647709d 1073741824" returned: 0 in 0.600s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1714b377-7284-4a56-924b-ad4fb647709d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:42 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1714b377-7284-4a56-924b-ad4fb647709d Sep 10 18:32:42 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:42 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:32:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Flow 'volume_create_manager' (f0cf283b-dd05-4929-9e1c-5de664223665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e86ca04-3c58-48dc-ad6b-0f845552c246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e86ca04-3c58-48dc-ad6b-0f845552c246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1032118564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=275d3de2-3d0c-46c6-bca8-b5399798196a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64004ea40c274241a1d9d163a2227f98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:43Z,use_quota=True,user_id='4a7f006edf8c4ce688174c33b9a524ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9677985-1ef6-46c7-a7c0-b5d0310edf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9677985-1ef6-46c7-a7c0-b5d0310edf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13ad86f-82a0-4a7f-854d-9ba62ab3ed6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:42 devstack cinder-volume[87842]: DEBUG cinder.image.glance [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Creating Keystone auth plugin from conf {{(pid=87842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 18:32:42 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1714b377-7284-4a56-924b-ad4fb647709d" returned: 0 in 0.373s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:32:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153764aa-2bb3-4c26-a743-f6498a8f1e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1714b377-7284-4a56-924b-ad4fb647709d', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e84110b-ac45-42d6-a68c-96c7b4ce5e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:43 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Volume volume-1714b377-7284-4a56-924b-ad4fb647709d (1714b377-7284-4a56-924b-ad4fb647709d): created successfully Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e84110b-ac45-42d6-a68c-96c7b4ce5e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Flow 'volume_create_manager' (899ded4d-7427-4282-bed2-84bc409c58a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:43 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-95eaed33-b63f-499d-9763-a6976f07eb15 tempest-VolumesTransfersV355Test-731092411 None] Created volume successfully. Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13ad86f-82a0-4a7f-854d-9ba62ab3ed6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '275d3de2-3d0c-46c6-bca8-b5399798196a', 'volume_name': 'volume-275d3de2-3d0c-46c6-bca8-b5399798196a', 'volume_size': 1, 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12fe9fd924464f1896748c45b7609239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'created_at': datetime.datetime(2026, 9, 10, 16, 14, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 14, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0312d110-0baa-405f-96b9-31d6f3adc458/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4311b967-1759-46b8-9f31-62afb8447e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4311b967-1759-46b8-9f31-62afb8447e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dfe6b6a-03a7-4c16-9526-b432dc9392e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:43 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Volume 275d3de2-3d0c-46c6-bca8-b5399798196a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-275d3de2-3d0c-46c6-bca8-b5399798196a', 'volume_size': 1, 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12fe9fd924464f1896748c45b7609239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'created_at': datetime.datetime(2026, 9, 10, 16, 14, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 14, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0312d110-0baa-405f-96b9-31d6f3adc458/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Trying to clone 275d3de2-3d0c-46c6-bca8-b5399798196a from image 0312d110-0baa-405f-96b9-31d6f3adc458 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]). {{(pid=87842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Flow 'volume_create_manager' (a69b6fbe-51e3-4cbf-aa78-2d89f1f8dc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827f3e55-a087-4a0f-9bfb-ec633efd0438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827f3e55-a087-4a0f-9bfb-ec633efd0438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288530490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce0407fa-e587-47e8-83db-ed1b042d9701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bfc00a63d047858a1c85f123bb6ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:43Z,use_quota=True,user_id='4f61ef74044a42eb90f7593e14df7fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6843d88-3ef0-4f8f-beb0-33b6cca3bd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6843d88-3ef0-4f8f-beb0-33b6cca3bd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a52bb0-8ebb-4b14-a944-92a3d642d204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a52bb0-8ebb-4b14-a944-92a3d642d204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce0407fa-e587-47e8-83db-ed1b042d9701', 'volume_name': 'volume-ce0407fa-e587-47e8-83db-ed1b042d9701', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599e2bba-6c76-4594-929c-9cb3efa3851c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599e2bba-6c76-4594-929c-9cb3efa3851c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac92935e-6aae-46fd-b7d9-a36a54b9352a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:43 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Volume ce0407fa-e587-47e8-83db-ed1b042d9701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce0407fa-e587-47e8-83db-ed1b042d9701', 'volume_size': 1} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288530490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce0407fa-e587-47e8-83db-ed1b042d9701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bfc00a63d047858a1c85f123bb6ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:43Z,use_quota=True,user_id='4f61ef74044a42eb90f7593e14df7fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Creating volume ce0407fa-e587-47e8-83db-ed1b042d9701 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:32:43 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce0407fa-e587-47e8-83db-ed1b042d9701 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:43 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce0407fa-e587-47e8-83db-ed1b042d9701 1073741824 Sep 10 18:32:43 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_s0a5o_7ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 18:32:43 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Image download 20.69 MB at 20.69 MB/s Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f42b31d-4f63-4621-82b7-7d670edc6289]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_s0a5o_7ldevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:43 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_s0a5o_7ldevstack@QuobyteHD Sep 10 18:32:43 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:43 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce0407fa-e587-47e8-83db-ed1b042d9701 1073741824" returned: 0 in 0.682s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce0407fa-e587-47e8-83db-ed1b042d9701 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:44 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_s0a5o_7ldevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Temporary image 0312d110-0baa-405f-96b9-31d6f3adc458 is fetched for user 4a7f006edf8c4ce688174c33b9a524ae. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 18:32:44 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce0407fa-e587-47e8-83db-ed1b042d9701 Sep 10 18:32:44 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2119f7d8-b5ed-4112-9e5a-126e55103923]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_s0a5o_7ldevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] Acquiring lock "cinder-1714b377-7284-4a56-924b-ad4fb647709d-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] Lock "cinder-1714b377-7284-4a56-924b-ad4fb647709d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:44 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_s0a5o_7ldevstack@QuobyteHD Sep 10 18:32:44 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] Acquiring lock "cinder-quobyte-1714b377-7284-4a56-924b-ad4fb647709d" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:44 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce0407fa-e587-47e8-83db-ed1b042d9701" returned: 0 in 0.413s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] Lock "cinder-quobyte-1714b377-7284-4a56-924b-ad4fb647709d" acquired by "delete_volume" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac92935e-6aae-46fd-b7d9-a36a54b9352a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce0407fa-e587-47e8-83db-ed1b042d9701', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f0a876-2098-4c37-a31b-d62523457d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a033dd79-e7be-4f07-841b-050f186e085a]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1714b377-7284-4a56-924b-ad4fb647709d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:44 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Volume volume-ce0407fa-e587-47e8-83db-ed1b042d9701 (ce0407fa-e587-47e8-83db-ed1b042d9701): created successfully Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f0a876-2098-4c37-a31b-d62523457d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Flow 'volume_create_manager' (a69b6fbe-51e3-4cbf-aa78-2d89f1f8dc42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:44 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-08974aeb-2f35-4f51-aa99-05132157411e tempest-ProjectReaderTests-316387561 None] Created volume successfully. Sep 10 18:32:44 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_s0a5o_7ldevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1032118564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=275d3de2-3d0c-46c6-bca8-b5399798196a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64004ea40c274241a1d9d163a2227f98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:43Z,use_quota=True,user_id='4a7f006edf8c4ce688174c33b9a524ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Creating volume 275d3de2-3d0c-46c6-bca8-b5399798196a {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:32:44 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:44 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1714b377-7284-4a56-924b-ad4fb647709d Sep 10 18:32:44 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:44 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a 1073741824 Sep 10 18:32:44 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:44 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1714b377-7284-4a56-924b-ad4fb647709d" returned: 0 in 0.470s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1714b377-7284-4a56-924b-ad4fb647709d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:45 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1714b377-7284-4a56-924b-ad4fb647709d Sep 10 18:32:45 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:45 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a 1073741824" returned: 0 in 0.485s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:45 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a Sep 10 18:32:45 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:45 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1714b377-7284-4a56-924b-ad4fb647709d" returned: 0 in 0.323s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] Lock "cinder-quobyte-1714b377-7284-4a56-924b-ad4fb647709d" released by "delete_volume" :: held 0.855s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] Acquiring lock "cinder-ce0407fa-e587-47e8-83db-ed1b042d9701-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] Lock "cinder-ce0407fa-e587-47e8-83db-ed1b042d9701-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] Created reservations ['e2094327-c063-490d-b3f1-efaed7a2723d', '8cf9a58e-a574-43a0-b2ed-d38050f06b3f', '52dc2c08-96c0-41a8-bced-f4f1aa115b13', 'bb9c7d78-e021-4080-bedf-681dae073158'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] Acquiring lock "cinder-quobyte-ce0407fa-e587-47e8-83db-ed1b042d9701" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:45 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a" returned: 0 in 0.340s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] Lock "cinder-quobyte-ce0407fa-e587-47e8-83db-ed1b042d9701" acquired by "delete_volume" :: waited 0.032s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa0ed13-9707-4d67-bb9f-1b943b30036f]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce0407fa-e587-47e8-83db-ed1b042d9701 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Attempting download of 0312d110-0baa-405f-96b9-31d6f3adc458 ((None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}])) to volume 275d3de2-3d0c-46c6-bca8-b5399798196a. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 18:32:45 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:32:45 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[711a9406-cfa2-4f25-b2ed-d5e8748f6a3f]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_gx7b3x6g {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:45 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_gx7b3x6g Sep 10 18:32:45 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:45 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce0407fa-e587-47e8-83db-ed1b042d9701 Sep 10 18:32:45 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:46 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.447s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:32:46 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] Deleted volume successfully. Sep 10 18:32:46 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b1ba0c6a-6002-4b68-8d1b-417f0865e467 tempest-VolumesTransfersV355Test-899091421 None] Lock "cinder-1714b377-7284-4a56-924b-ad4fb647709d-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_gx7b3x6g" returned: 0 in 0.440s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_gx7b3x6g {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:46 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce0407fa-e587-47e8-83db-ed1b042d9701" returned: 0 in 0.636s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce0407fa-e587-47e8-83db-ed1b042d9701 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:46 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce0407fa-e587-47e8-83db-ed1b042d9701 Sep 10 18:32:46 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:46 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_gx7b3x6g Sep 10 18:32:46 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:46 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ce0407fa-e587-47e8-83db-ed1b042d9701" returned: 0 in 0.331s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] Lock "cinder-quobyte-ce0407fa-e587-47e8-83db-ed1b042d9701" released by "delete_volume" :: held 1.062s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:46 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_gx7b3x6g" returned: 1 in 0.537s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_gx7b3x6g' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8b2200-21f2-49d2-8fd5-92762ada92ef]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_s0a5o_7ldevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] Created reservations ['c5cd20df-6d35-4415-8cb2-b829572138c1', '38221009-5949-4bf8-9494-0150eccf5f04', '7fb6bae3-cb0d-4ddb-a8e9-ffb13f4360c0', 'f59b6d54-7c44-4ea1-a9b4-547bdde0b030'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:46 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_s0a5o_7ldevstack@QuobyteHD Sep 10 18:32:46 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:46 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:32:46 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:47 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.337s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:47 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:32:47 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:47 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] Deleted volume successfully. Sep 10 18:32:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_s0a5o_7ldevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:47 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] 0312d110-0baa-405f-96b9-31d6f3adc458 was qcow2, converting to qcow2 {{(pid=87842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 18:32:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_s0a5o_7ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:47 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c6704ec9-c864-42cc-9514-9bbf48ef99f6 tempest-ProjectReaderTests-316387561 None] Lock "cinder-ce0407fa-e587-47e8-83db-ed1b042d9701-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:47 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_s0a5o_7ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a Sep 10 18:32:47 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:49 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_s0a5o_7ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a" returned: 0 in 2.421s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:49 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_s0a5o_7ldevstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:32:49 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Converted 112.00 MB image at 46.24 MB/s Sep 10 18:32:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:49 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a 1G Sep 10 18:32:49 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:50 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a 1G" returned: 0 in 0.462s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:50 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Downloaded image 0312d110-0baa-405f-96b9-31d6f3adc458 ((None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}])) to volume 275d3de2-3d0c-46c6-bca8-b5399798196a successfully. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 18:32:50 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Temporary image 0312d110-0baa-405f-96b9-31d6f3adc458 for user 4a7f006edf8c4ce688174c33b9a524ae is deleted. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 18:32:50 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Marking volume 275d3de2-3d0c-46c6-bca8-b5399798196a as bootable. {{(pid=87842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 18:32:50 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Copying metadata from image 0312d110-0baa-405f-96b9-31d6f3adc458 to 275d3de2-3d0c-46c6-bca8-b5399798196a. {{(pid=87842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 18:32:50 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Creating volume glance metadata for volume 275d3de2-3d0c-46c6-bca8-b5399798196a backed by image 0312d110-0baa-405f-96b9-31d6f3adc458 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 18:32:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dfe6b6a-03a7-4c16-9526-b432dc9392e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-275d3de2-3d0c-46c6-bca8-b5399798196a', 'volume_size': 1, 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12fe9fd924464f1896748c45b7609239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'created_at': datetime.datetime(2026, 9, 10, 16, 14, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 14, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0312d110-0baa-405f-96b9-31d6f3adc458/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56ca32b-3619-4613-8270-2a56632bad17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:50 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Volume volume-275d3de2-3d0c-46c6-bca8-b5399798196a (275d3de2-3d0c-46c6-bca8-b5399798196a): created successfully Sep 10 18:32:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56ca32b-3619-4613-8270-2a56632bad17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:50 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Flow 'volume_create_manager' (f0cf283b-dd05-4929-9e1c-5de664223665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:50 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-386c46f8-3418-470e-9d16-3b26d649e463 tempest-VolumesExtendTest-325829360 None] Created volume successfully. Sep 10 18:32:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-98b7bfba-797c-418d-bc3e-b8d58bf8a0ea tempest-VolumesExtendTest-325829360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-98b7bfba-797c-418d-bc3e-b8d58bf8a0ea tempest-VolumesExtendTest-325829360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:51 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42908dc-d988-4546-9f22-03a201610270]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-98b7bfba-797c-418d-bc3e-b8d58bf8a0ea tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:51 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a Sep 10 18:32:51 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:51 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-98b7bfba-797c-418d-bc3e-b8d58bf8a0ea tempest-VolumesExtendTest-325829360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a" returned: 0 in 0.415s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-98b7bfba-797c-418d-bc3e-b8d58bf8a0ea tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a 2G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-98b7bfba-797c-418d-bc3e-b8d58bf8a0ea tempest-VolumesExtendTest-325829360 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a 2G" returned: 0 in 0.105s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-98b7bfba-797c-418d-bc3e-b8d58bf8a0ea tempest-VolumesExtendTest-325829360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.549s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:52 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=123,cinder:UPDATE=145,cinder:DELETE=13,cinder:INSERT=39 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:32:52 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-98b7bfba-797c-418d-bc3e-b8d58bf8a0ea tempest-VolumesExtendTest-325829360 None] Extend volume completed successfully. Sep 10 18:32:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] Acquiring lock "cinder-275d3de2-3d0c-46c6-bca8-b5399798196a-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] Lock "cinder-275d3de2-3d0c-46c6-bca8-b5399798196a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] Acquiring lock "cinder-quobyte-275d3de2-3d0c-46c6-bca8-b5399798196a" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:32:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] Lock "cinder-quobyte-275d3de2-3d0c-46c6-bca8-b5399798196a" acquired by "delete_volume" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:32:53 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cfd968-a783-45bd-912c-c5b4a5ce3672]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:53 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a Sep 10 18:32:53 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:53 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a" returned: 0 in 0.407s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:53 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a Sep 10 18:32:53 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:53 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-275d3de2-3d0c-46c6-bca8-b5399798196a" returned: 0 in 0.309s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] Lock "cinder-quobyte-275d3de2-3d0c-46c6-bca8-b5399798196a" released by "delete_volume" :: held 0.763s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:53 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] Created reservations ['c36f4077-ecd7-44c6-a63a-8620f41fb27c', '0aeb197f-4044-467e-9b06-a0190e147c13', 'f458404a-c3ee-4d8a-8e07-41b35227e3cd', '542086e6-0e8a-4255-b46c-ccc7b3472ece'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:54 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:32:54 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:54 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.289s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:32:54 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] Deleted volume successfully. Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6a4b6bd4-eab8-44b5-96b4-efd4faadda7d tempest-VolumesExtendTest-325829360 None] Lock "cinder-275d3de2-3d0c-46c6-bca8-b5399798196a-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Flow 'volume_create_manager' (2b504752-96d9-4c9b-97fc-7c4394e52d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb30d3a-80f6-4f90-a954-d44d7315d360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=121,cinder:UPDATE=178,cinder:INSERT=48,cinder:DELETE=14 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb30d3a-80f6-4f90-a954-d44d7315d360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-609426166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e47de1-8ac7-4da6-abc4-69bb7ec06077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64004ea40c274241a1d9d163a2227f98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:55Z,use_quota=True,user_id='4a7f006edf8c4ce688174c33b9a524ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe991b3-b4e0-4757-8de0-e72da547f64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe991b3-b4e0-4757-8de0-e72da547f64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c831a7-e658-4dfa-90d0-918adbae50e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c831a7-e658-4dfa-90d0-918adbae50e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47e47de1-8ac7-4da6-abc4-69bb7ec06077', 'volume_name': 'volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f33126a-86ac-41a0-9d5e-872cb4f94af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f33126a-86ac-41a0-9d5e-872cb4f94af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd90a292-6e73-4ec0-8b82-2fdbb9a19cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:54 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Volume 47e47de1-8ac7-4da6-abc4-69bb7ec06077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077', 'volume_size': 1} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-609426166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e47de1-8ac7-4da6-abc4-69bb7ec06077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64004ea40c274241a1d9d163a2227f98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:32:55Z,use_quota=True,user_id='4a7f006edf8c4ce688174c33b9a524ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Creating volume 47e47de1-8ac7-4da6-abc4-69bb7ec06077 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:32:54 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:32:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:54 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077 1073741824 Sep 10 18:32:54 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:55 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077 1073741824" returned: 0 in 0.629s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:55 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077 Sep 10 18:32:55 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:55 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077" returned: 0 in 0.302s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:55 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:32:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd90a292-6e73-4ec0-8b82-2fdbb9a19cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208532a2-7e9c-4f7f-9878-906e01975437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:32:55 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Volume volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077 (47e47de1-8ac7-4da6-abc4-69bb7ec06077): created successfully Sep 10 18:32:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208532a2-7e9c-4f7f-9878-906e01975437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:32:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Flow 'volume_create_manager' (2b504752-96d9-4c9b-97fc-7c4394e52d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:32:55 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c7cfba31-ffae-4541-beb1-bb88359fe67f tempest-VolumesExtendTest-325829360 None] Created volume successfully. Sep 10 18:32:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ab369525-4c16-4139-a471-9a581514eb62 tempest-VolumesExtendTest-325829360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:32:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ab369525-4c16-4139-a471-9a581514eb62 tempest-VolumesExtendTest-325829360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:32:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-ab369525-4c16-4139-a471-9a581514eb62 tempest-VolumesExtendTest-325829360 None] Creating offline snapshot 8350c68e-93de-4fc2-a279-ca992765cc7a of volume 47e47de1-8ac7-4da6-abc4-69bb7ec06077 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:32:57 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93d1c16-a4eb-4d09-96a8-0ec7e4ba049b]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:32:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ab369525-4c16-4139-a471-9a581514eb62 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:57 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077 Sep 10 18:32:57 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:57 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ab369525-4c16-4139-a471-9a581514eb62 tempest-VolumesExtendTest-325829360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077" returned: 0 in 0.474s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ab369525-4c16-4139-a471-9a581514eb62 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:57 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a 1G Sep 10 18:32:57 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:58 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ab369525-4c16-4139-a471-9a581514eb62 tempest-VolumesExtendTest-325829360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a 1G" returned: 0 in 0.580s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ab369525-4c16-4139-a471-9a581514eb62 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:58 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a Sep 10 18:32:58 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:58 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ab369525-4c16-4139-a471-9a581514eb62 tempest-VolumesExtendTest-325829360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a" returned: 0 in 0.385s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:58 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-ab369525-4c16-4139-a471-9a581514eb62 tempest-VolumesExtendTest-325829360 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a is being set with open permissions: ugo+rw Sep 10 18:32:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ab369525-4c16-4139-a471-9a581514eb62 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:58 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a Sep 10 18:32:58 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:58 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ab369525-4c16-4139-a471-9a581514eb62 tempest-VolumesExtendTest-325829360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a" returned: 0 in 0.263s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ab369525-4c16-4139-a471-9a581514eb62 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:58 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.info Sep 10 18:32:58 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:59 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ab369525-4c16-4139-a471-9a581514eb62 tempest-VolumesExtendTest-325829360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.info" returned: 0 in 0.311s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:59 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-ab369525-4c16-4139-a471-9a581514eb62 tempest-VolumesExtendTest-325829360 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.info is being set with open permissions: ugo+rw Sep 10 18:32:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ab369525-4c16-4139-a471-9a581514eb62 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:32:59 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.info Sep 10 18:32:59 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:32:59 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Sep 10 18:32:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ab369525-4c16-4139-a471-9a581514eb62 tempest-VolumesExtendTest-325829360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.info" returned: 0 in 0.297s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:32:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ab369525-4c16-4139-a471-9a581514eb62 tempest-VolumesExtendTest-325829360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.438s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:32:59 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ab369525-4c16-4139-a471-9a581514eb62 tempest-VolumesExtendTest-325829360 None] Create snapshot completed successfully Sep 10 18:33:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-602a636e-fa4b-4c60-8b86-f37dd9052d78 tempest-VolumesExtendTest-325829360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:33:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-602a636e-fa4b-4c60-8b86-f37dd9052d78 tempest-VolumesExtendTest-325829360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:33:00 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7850409b-5d99-418b-9bdb-d70fd036abde]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:33:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-602a636e-fa4b-4c60-8b86-f37dd9052d78 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:00 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077 Sep 10 18:33:00 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:00 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-602a636e-fa4b-4c60-8b86-f37dd9052d78 tempest-VolumesExtendTest-325829360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077" returned: 0 in 0.435s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-602a636e-fa4b-4c60-8b86-f37dd9052d78 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a 2G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-602a636e-fa4b-4c60-8b86-f37dd9052d78 tempest-VolumesExtendTest-325829360 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a 2G" returned: 0 in 0.168s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-602a636e-fa4b-4c60-8b86-f37dd9052d78 tempest-VolumesExtendTest-325829360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.646s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:33:01 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-602a636e-fa4b-4c60-8b86-f37dd9052d78 tempest-VolumesExtendTest-325829360 None] Extend volume completed successfully. Sep 10 18:33:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] Acquiring lock "cinder-8350c68e-93de-4fc2-a279-ca992765cc7a-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:33:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] Lock "cinder-8350c68e-93de-4fc2-a279-ca992765cc7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:33:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] Acquiring lock "cinder-quobyte-47e47de1-8ac7-4da6-abc4-69bb7ec06077" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:33:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] Lock "cinder-quobyte-47e47de1-8ac7-4da6-abc4-69bb7ec06077" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:33:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] Acquiring lock "cinder-quobyte-8350c68e-93de-4fc2-a279-ca992765cc7a" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:33:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] Lock "cinder-quobyte-8350c68e-93de-4fc2-a279-ca992765cc7a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:33:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] Deleting offline snapshot 8350c68e-93de-4fc2-a279-ca992765cc7a of volume 47e47de1-8ac7-4da6-abc4-69bb7ec06077 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:33:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] snapshot_file for this snap is: volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:33:01 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b4b32d-e4e6-41e6-b1ee-9235a84bcbc3]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:33:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:01 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a Sep 10 18:33:01 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:02 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a" returned: 0 in 0.452s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:33:02 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99205b0-f53c-48bb-9a5a-c2061fb16551]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:33:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:02 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077 Sep 10 18:33:02 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:02 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077" returned: 0 in 0.488s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:02 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a Sep 10 18:33:02 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:03 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a" returned: 0 in 0.426s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:03 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a Sep 10 18:33:03 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:03 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077.8350c68e-93de-4fc2-a279-ca992765cc7a" returned: 0 in 0.283s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] Lock "cinder-quobyte-8350c68e-93de-4fc2-a279-ca992765cc7a" released by "_delete_snapshot" :: held 1.789s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:33:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] Lock "cinder-quobyte-47e47de1-8ac7-4da6-abc4-69bb7ec06077" released by "delete_snapshot" :: held 1.826s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:33:03 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] Created reservations ['cafb151f-f5c3-41f6-b72f-f35bdb9e9b9b', 'e9a03901-d962-484b-9a4a-01bbf7ac5bd5', 'b129b7dc-301a-4f26-9a9b-84e379ec045f', '042ad33e-92d3-4b29-8222-41653a9a2e9d'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:33:03 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] Delete snapshot completed successfully. Sep 10 18:33:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-763ac9e6-5449-499a-86de-2cd8f72aa8b9 tempest-VolumesExtendTest-325829360 None] Lock "cinder-8350c68e-93de-4fc2-a279-ca992765cc7a-delete_snapshot" released by "delete_snapshot" :: held 1.997s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:33:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] Acquiring lock "cinder-47e47de1-8ac7-4da6-abc4-69bb7ec06077-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:33:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] Lock "cinder-47e47de1-8ac7-4da6-abc4-69bb7ec06077-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:33:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] Acquiring lock "cinder-quobyte-47e47de1-8ac7-4da6-abc4-69bb7ec06077" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:33:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] Lock "cinder-quobyte-47e47de1-8ac7-4da6-abc4-69bb7ec06077" acquired by "delete_volume" :: waited 0.018s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:33:04 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b37bc1-bf95-4fd6-ab37-3756e6183024]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:33:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:04 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077 Sep 10 18:33:04 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:04 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077" returned: 0 in 0.428s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:04 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077 Sep 10 18:33:04 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:04 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-47e47de1-8ac7-4da6-abc4-69bb7ec06077" returned: 0 in 0.315s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] Lock "cinder-quobyte-47e47de1-8ac7-4da6-abc4-69bb7ec06077" released by "delete_volume" :: held 0.816s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:33:05 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] Created reservations ['38cda049-c4d1-4dfd-a5f6-92997b11cfe3', '0e0ad02c-3063-4628-8622-c24ffcff9e49', 'ace73ce0-702d-45c9-b517-f4956cb65781', '1143590d-59b6-48b9-885b-cad323f3bc8b'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:33:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:33:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:33:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:33:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:33:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:33:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:05 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:33:05 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:05 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.371s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:05 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:33:05 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] Deleted volume successfully. Sep 10 18:33:05 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-156ae888-1fd3-4b6e-b7c7-be3d59133f01 tempest-VolumesExtendTest-325829360 None] Lock "cinder-47e47de1-8ac7-4da6-abc4-69bb7ec06077-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Flow 'volume_create_manager' (8f9749a5-f1cc-4b81-825a-9d051edac30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30550118-e20e-4393-bed2-6c7f23563a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30550118-e20e-4393-bed2-6c7f23563a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1844306748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d140238-c52a-483a-bee9-a9df0651fd8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f05487a6b848ea8eb99d68fae590b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:33:08Z,use_quota=True,user_id='ce3f73cec7a2434789066651c91ffb7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40340406-8591-4e98-8be2-d5d23cc0d264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40340406-8591-4e98-8be2-d5d23cc0d264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb2aea6-6744-4d36-9e99-2fc8f98f216b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb2aea6-6744-4d36-9e99-2fc8f98f216b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d140238-c52a-483a-bee9-a9df0651fd8a', 'volume_name': 'volume-4d140238-c52a-483a-bee9-a9df0651fd8a', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf051393-e545-4e23-8f81-678f4e271371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf051393-e545-4e23-8f81-678f4e271371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c79480ed-fba1-4a99-895e-4379273417f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:08 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Volume 4d140238-c52a-483a-bee9-a9df0651fd8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d140238-c52a-483a-bee9-a9df0651fd8a', 'volume_size': 1} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1844306748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d140238-c52a-483a-bee9-a9df0651fd8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f05487a6b848ea8eb99d68fae590b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:33:08Z,use_quota=True,user_id='ce3f73cec7a2434789066651c91ffb7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Creating volume 4d140238-c52a-483a-bee9-a9df0651fd8a {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:33:08 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:33:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:08 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a 1073741824 Sep 10 18:33:08 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:09 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a 1073741824" returned: 0 in 0.607s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:09 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a Sep 10 18:33:09 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:09 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a" returned: 0 in 0.344s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:33:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:33:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c79480ed-fba1-4a99-895e-4379273417f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d140238-c52a-483a-bee9-a9df0651fd8a', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810272ed-a50a-4c91-8049-7515055e4e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:09 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Volume volume-4d140238-c52a-483a-bee9-a9df0651fd8a (4d140238-c52a-483a-bee9-a9df0651fd8a): created successfully Sep 10 18:33:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810272ed-a50a-4c91-8049-7515055e4e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Flow 'volume_create_manager' (8f9749a5-f1cc-4b81-825a-9d051edac30d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:33:09 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-263a8ed6-f1b2-460f-be09-0070036f94b5 tempest-TestStampPattern-418652832 None] Created volume successfully. Sep 10 18:33:10 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:33:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Flow 'volume_create_manager' (306df2de-5ec9-4861-93cc-da4ece552533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:33:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8726cf-4f50-4653-8d4f-53248cc46012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8726cf-4f50-4653-8d4f-53248cc46012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-655259115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21804e3-c7df-4c85-bc8e-51e81f820eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cebfd0c98ca45b38da569aab7db29cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:33:11Z,use_quota=True,user_id='6e0d8163364a4f28b8efacdbac76005e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35feb376-ac4c-487d-bb11-c9de4feecca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35feb376-ac4c-487d-bb11-c9de4feecca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb304789-8521-4522-8639-0c4368607d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb304789-8521-4522-8639-0c4368607d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd21804e3-c7df-4c85-bc8e-51e81f820eb6', 'volume_name': 'volume-d21804e3-c7df-4c85-bc8e-51e81f820eb6', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6bdd69-6302-4e99-bfbf-557555b79652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6bdd69-6302-4e99-bfbf-557555b79652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc926ab8-7b7e-4f68-8254-c8377e0c0504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:11 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Volume d21804e3-c7df-4c85-bc8e-51e81f820eb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d21804e3-c7df-4c85-bc8e-51e81f820eb6', 'volume_size': 1} Sep 10 18:33:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:33:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:33:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-655259115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21804e3-c7df-4c85-bc8e-51e81f820eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cebfd0c98ca45b38da569aab7db29cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:33:11Z,use_quota=True,user_id='6e0d8163364a4f28b8efacdbac76005e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:33:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Creating volume d21804e3-c7df-4c85-bc8e-51e81f820eb6 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:33:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:33:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:33:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:33:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:33:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:33:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:33:11 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:33:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d21804e3-c7df-4c85-bc8e-51e81f820eb6 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:11 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d21804e3-c7df-4c85-bc8e-51e81f820eb6 1073741824 Sep 10 18:33:11 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:11 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d21804e3-c7df-4c85-bc8e-51e81f820eb6 1073741824" returned: 0 in 0.565s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d21804e3-c7df-4c85-bc8e-51e81f820eb6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:11 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d21804e3-c7df-4c85-bc8e-51e81f820eb6 Sep 10 18:33:11 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:11 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d21804e3-c7df-4c85-bc8e-51e81f820eb6" returned: 0 in 0.323s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:33:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:33:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc926ab8-7b7e-4f68-8254-c8377e0c0504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d21804e3-c7df-4c85-bc8e-51e81f820eb6', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38613274-9d8c-4ecd-9445-6baa0050d343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:12 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Volume volume-d21804e3-c7df-4c85-bc8e-51e81f820eb6 (d21804e3-c7df-4c85-bc8e-51e81f820eb6): created successfully Sep 10 18:33:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38613274-9d8c-4ecd-9445-6baa0050d343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Flow 'volume_create_manager' (306df2de-5ec9-4861-93cc-da4ece552533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:33:12 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-5942c958-5aa0-4e84-a51a-ed6b2f07f7f4 tempest-VolumesNegativeTest-1695269589 None] Created volume successfully. Sep 10 18:33:22 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=20,cinder:INSERT=7,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:33:22 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=30,cinder:INSERT=7,cinder:UPDATE=38,cinder:DELETE=4 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:33:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:33:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:33:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:33:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:33:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:33:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:33:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:29 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:33:29 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:29 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.511s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:33:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:33:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 28 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:33:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Flow 'volume_create_manager' (eb58698c-f44f-4896-a10d-5b7fb3a8e06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ce5914-a65e-46e4-9512-188bf766f918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ce5914-a65e-46e4-9512-188bf766f918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2068223099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2edd56-b5d6-4585-a555-10aa4d1867c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de24a263be3423d8539945fa261f10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:33:37Z,use_quota=True,user_id='6dc178c51f7c4242840ae60549ed41c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22498551-ba54-43f4-9707-797efdc72f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22498551-ba54-43f4-9707-797efdc72f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506777ec-78f5-4837-abac-130685d8655f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506777ec-78f5-4837-abac-130685d8655f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be2edd56-b5d6-4585-a555-10aa4d1867c6', 'volume_name': 'volume-be2edd56-b5d6-4585-a555-10aa4d1867c6', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85663da5-0b3f-4964-9209-5a33cdb01656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85663da5-0b3f-4964-9209-5a33cdb01656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74109ac-2f47-4c02-a68c-e272fa35aa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:37 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Volume be2edd56-b5d6-4585-a555-10aa4d1867c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be2edd56-b5d6-4585-a555-10aa4d1867c6', 'volume_size': 1} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2068223099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2edd56-b5d6-4585-a555-10aa4d1867c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de24a263be3423d8539945fa261f10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:33:37Z,use_quota=True,user_id='6dc178c51f7c4242840ae60549ed41c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Creating volume be2edd56-b5d6-4585-a555-10aa4d1867c6 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:33:37 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-be2edd56-b5d6-4585-a555-10aa4d1867c6 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:37 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-be2edd56-b5d6-4585-a555-10aa4d1867c6 1073741824 Sep 10 18:33:37 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:37 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-be2edd56-b5d6-4585-a555-10aa4d1867c6 1073741824" returned: 0 in 0.507s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-be2edd56-b5d6-4585-a555-10aa4d1867c6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:37 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-be2edd56-b5d6-4585-a555-10aa4d1867c6 Sep 10 18:33:37 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:38 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-be2edd56-b5d6-4585-a555-10aa4d1867c6" returned: 0 in 0.370s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:33:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:33:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74109ac-2f47-4c02-a68c-e272fa35aa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be2edd56-b5d6-4585-a555-10aa4d1867c6', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e46c5fb-b696-46e0-afab-b4763c5e5802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:38 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Volume volume-be2edd56-b5d6-4585-a555-10aa4d1867c6 (be2edd56-b5d6-4585-a555-10aa4d1867c6): created successfully Sep 10 18:33:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e46c5fb-b696-46e0-afab-b4763c5e5802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Flow 'volume_create_manager' (eb58698c-f44f-4896-a10d-5b7fb3a8e06d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:33:38 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-0f93c7a7-b065-42e3-b448-4f9c56fbde4d tempest-TestMinimumBasicScenario-450204744 None] Created volume successfully. Sep 10 18:33:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-39b21002-0df0-4e14-ad39-bee43000498e req-e43aa238-0b65-4f76-90b3-36cfc636a86f tempest-TestStampPattern-418652832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:33:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-39b21002-0df0-4e14-ad39-bee43000498e req-e43aa238-0b65-4f76-90b3-36cfc636a86f tempest-TestStampPattern-418652832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:33:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-39b21002-0df0-4e14-ad39-bee43000498e req-e43aa238-0b65-4f76-90b3-36cfc636a86f tempest-TestStampPattern-418652832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:33:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-39b21002-0df0-4e14-ad39-bee43000498e req-e43aa238-0b65-4f76-90b3-36cfc636a86f tempest-TestStampPattern-418652832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-4d140238-c52a-483a-bee9-a9df0651fd8a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43e7c279-350a-42ad-89ac-79d72801c2e6', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:33:40 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-39b21002-0df0-4e14-ad39-bee43000498e req-e43aa238-0b65-4f76-90b3-36cfc636a86f tempest-TestStampPattern-418652832 None] attachment_update completed successfully. Sep 10 18:33:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] Acquiring lock "cinder-d21804e3-c7df-4c85-bc8e-51e81f820eb6-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:33:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] Lock "cinder-d21804e3-c7df-4c85-bc8e-51e81f820eb6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:33:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] Acquiring lock "cinder-quobyte-d21804e3-c7df-4c85-bc8e-51e81f820eb6" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:33:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] Lock "cinder-quobyte-d21804e3-c7df-4c85-bc8e-51e81f820eb6" acquired by "delete_volume" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:33:40 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f52003-3b84-41fe-82a4-214e0509f6e7]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:33:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d21804e3-c7df-4c85-bc8e-51e81f820eb6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:40 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d21804e3-c7df-4c85-bc8e-51e81f820eb6 Sep 10 18:33:40 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-9fd86ce2-bb8c-4c0e-af96-bf6f37d5fa06 req-2d802573-12ee-4732-818b-ae17da9cbe78 tempest-TestMinimumBasicScenario-450204744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:33:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-9fd86ce2-bb8c-4c0e-af96-bf6f37d5fa06 req-2d802573-12ee-4732-818b-ae17da9cbe78 tempest-TestMinimumBasicScenario-450204744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:33:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-9fd86ce2-bb8c-4c0e-af96-bf6f37d5fa06 req-2d802573-12ee-4732-818b-ae17da9cbe78 tempest-TestMinimumBasicScenario-450204744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:33:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-9fd86ce2-bb8c-4c0e-af96-bf6f37d5fa06 req-2d802573-12ee-4732-818b-ae17da9cbe78 tempest-TestMinimumBasicScenario-450204744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-be2edd56-b5d6-4585-a555-10aa4d1867c6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0133d0d4-2b9d-4614-8f1c-1852437cf5a7', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:33:40 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-9fd86ce2-bb8c-4c0e-af96-bf6f37d5fa06 req-2d802573-12ee-4732-818b-ae17da9cbe78 tempest-TestMinimumBasicScenario-450204744 None] attachment_update completed successfully. Sep 10 18:33:41 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d21804e3-c7df-4c85-bc8e-51e81f820eb6" returned: 0 in 0.484s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d21804e3-c7df-4c85-bc8e-51e81f820eb6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:41 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d21804e3-c7df-4c85-bc8e-51e81f820eb6 Sep 10 18:33:41 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:41 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d21804e3-c7df-4c85-bc8e-51e81f820eb6" returned: 0 in 0.368s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] Lock "cinder-quobyte-d21804e3-c7df-4c85-bc8e-51e81f820eb6" released by "delete_volume" :: held 0.941s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:33:41 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] Created reservations ['fd515059-850d-4de2-935e-2bb6ff59e0e0', 'f13b14f9-803c-47d3-acf7-05fa1c5aa67a', 'd57961f7-f63c-485b-8682-10b76a3fcc0b', '8396e480-a9e5-470c-8223-6925251299ff'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:33:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:33:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:33:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:33:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:33:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:33:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:41 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:33:41 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:41 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.285s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:41 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:33:41 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] Deleted volume successfully. Sep 10 18:33:42 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d9b5820b-2ee9-4701-80fb-b534581ed4d8 tempest-VolumesNegativeTest-1695269589 None] Lock "cinder-d21804e3-c7df-4c85-bc8e-51e81f820eb6-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:33:45 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-c6d1a83c-266c-4f27-91a5-4f5e1dce0523 req-ba70ec5c-7ab9-483c-920c-26dcb1f0b028 tempest-TestStampPattern-418652832 None] Terminate volume connection completed successfully. Sep 10 18:33:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-c6d1a83c-266c-4f27-91a5-4f5e1dce0523 req-ba70ec5c-7ab9-483c-920c-26dcb1f0b028 tempest-TestStampPattern-418652832 None] Deleting attachment 43e7c279-350a-42ad-89ac-79d72801c2e6. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:33:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5ee0df9b-2e44-444c-baf9-221746590d09 tempest-TestStampPattern-418652832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:33:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5ee0df9b-2e44-444c-baf9-221746590d09 tempest-TestStampPattern-418652832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:33:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5ee0df9b-2e44-444c-baf9-221746590d09 tempest-TestStampPattern-418652832 None] Creating offline snapshot 361d0176-a975-4240-8484-5b9c9f9c033e of volume 4d140238-c52a-483a-bee9-a9df0651fd8a {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:33:46 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[76219090-b915-4a88-b33b-1ae4b0517b54]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:33:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ee0df9b-2e44-444c-baf9-221746590d09 tempest-TestStampPattern-418652832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:47 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a Sep 10 18:33:47 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:47 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ee0df9b-2e44-444c-baf9-221746590d09 tempest-TestStampPattern-418652832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a" returned: 0 in 0.496s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ee0df9b-2e44-444c-baf9-221746590d09 tempest-TestStampPattern-418652832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:47 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e 1G Sep 10 18:33:47 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:48 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ee0df9b-2e44-444c-baf9-221746590d09 tempest-TestStampPattern-418652832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e 1G" returned: 0 in 0.746s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ee0df9b-2e44-444c-baf9-221746590d09 tempest-TestStampPattern-418652832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d140238-c52a-483a-bee9-a9df0651fd8a -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:48 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d140238-c52a-483a-bee9-a9df0651fd8a -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e Sep 10 18:33:48 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:48 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ee0df9b-2e44-444c-baf9-221746590d09 tempest-TestStampPattern-418652832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d140238-c52a-483a-bee9-a9df0651fd8a -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e" returned: 0 in 0.391s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:48 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-5ee0df9b-2e44-444c-baf9-221746590d09 tempest-TestStampPattern-418652832 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e is being set with open permissions: ugo+rw Sep 10 18:33:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ee0df9b-2e44-444c-baf9-221746590d09 tempest-TestStampPattern-418652832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:48 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e Sep 10 18:33:48 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:48 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ee0df9b-2e44-444c-baf9-221746590d09 tempest-TestStampPattern-418652832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e" returned: 0 in 0.326s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ee0df9b-2e44-444c-baf9-221746590d09 tempest-TestStampPattern-418652832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:49 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.info Sep 10 18:33:49 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:49 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ee0df9b-2e44-444c-baf9-221746590d09 tempest-TestStampPattern-418652832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.info" returned: 0 in 0.346s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:49 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-5ee0df9b-2e44-444c-baf9-221746590d09 tempest-TestStampPattern-418652832 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.info is being set with open permissions: ugo+rw Sep 10 18:33:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ee0df9b-2e44-444c-baf9-221746590d09 tempest-TestStampPattern-418652832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:49 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.info Sep 10 18:33:49 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:49 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ee0df9b-2e44-444c-baf9-221746590d09 tempest-TestStampPattern-418652832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.info" returned: 0 in 0.278s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5ee0df9b-2e44-444c-baf9-221746590d09 tempest-TestStampPattern-418652832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.701s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:33:49 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-5ee0df9b-2e44-444c-baf9-221746590d09 tempest-TestStampPattern-418652832 None] Create snapshot completed successfully Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Flow 'volume_create_manager' (ac0d7337-ae96-49e8-94a4-674e35acaa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff4d878-7f19-4249-baf0-24b125acfd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff4d878-7f19-4249-baf0-24b125acfd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-133570319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495253fd-18ba-4db2-a889-7c22843d0de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f05487a6b848ea8eb99d68fae590b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=361d0176-a975-4240-8484-5b9c9f9c033e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:33:58Z,use_quota=True,user_id='ce3f73cec7a2434789066651c91ffb7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9038b37-99ef-46bd-ab30-222c48afc07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9038b37-99ef-46bd-ab30-222c48afc07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acd180f-d80f-40a1-a405-954f793dd846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acd180f-d80f-40a1-a405-954f793dd846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '495253fd-18ba-4db2-a889-7c22843d0de5', 'volume_name': 'volume-495253fd-18ba-4db2-a889-7c22843d0de5', 'volume_size': 1, 'snapshot_id': '361d0176-a975-4240-8484-5b9c9f9c033e'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd3e61d2-3601-464a-9434-bed6e8a7d807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd3e61d2-3601-464a-9434-bed6e8a7d807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a99b9d-6670-4fe7-9c23-6c14a834f2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:33:58 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Volume 495253fd-18ba-4db2-a889-7c22843d0de5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-495253fd-18ba-4db2-a889-7c22843d0de5', 'volume_size': 1, 'snapshot_id': '361d0176-a975-4240-8484-5b9c9f9c033e'} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Acquiring lock "cinder-quobyte-361d0176-a975-4240-8484-5b9c9f9c033e-495253fd-18ba-4db2-a889-7c22843d0de5" by "_create_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Lock "cinder-quobyte-361d0176-a975-4240-8484-5b9c9f9c033e-495253fd-18ba-4db2-a889-7c22843d0de5" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Creating volume 495253fd-18ba-4db2-a889-7c22843d0de5 from snapshot 361d0176-a975-4240-8484-5b9c9f9c033e {{(pid=87842) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Acquiring lock "cinder-quobyte-495253fd-18ba-4db2-a889-7c22843d0de5" by "_copy_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Lock "cinder-quobyte-495253fd-18ba-4db2-a889-7c22843d0de5" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] snapshot: 361d0176-a975-4240-8484-5b9c9f9c033e, volume: 495253fd-18ba-4db2-a889-7c22843d0de5, {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e796c3ea-5b2b-4c5c-9716-1a1b533e4dfc]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:33:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:58 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e Sep 10 18:33:58 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:59 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e" returned: 0 in 0.484s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d140238-c52a-483a-bee9-a9df0651fd8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:33:59 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c008db7-362f-4a70-b8cb-607a823503a1]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:33:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:59 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a Sep 10 18:33:59 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:33:59 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Sep 10 18:33:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a" returned: 0 in 0.456s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:33:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 18:33:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Creating direct copy from snapshot {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 18:33:59 devstack cinder-volume[87842]: DEBUG cinder.utils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Path /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-495253fd-18ba-4db2-a889-7c22843d0de5 not found in is_blk_device check {{(pid=87842) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 18:33:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-495253fd-18ba-4db2-a889-7c22843d0de5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:33:59 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-495253fd-18ba-4db2-a889-7c22843d0de5 Sep 10 18:33:59 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:07 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-495253fd-18ba-4db2-a889-7c22843d0de5" returned: 0 in 7.786s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:07 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Image conversion details: src /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a, size 1024.00 MB, duration 7.79 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-495253fd-18ba-4db2-a889-7c22843d0de5 {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:34:07 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Converted 1024.00 MB image at 131.49 MB/s Sep 10 18:34:07 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-495253fd-18ba-4db2-a889-7c22843d0de5 is being set with open permissions: ugo+rw Sep 10 18:34:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-495253fd-18ba-4db2-a889-7c22843d0de5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:07 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-495253fd-18ba-4db2-a889-7c22843d0de5 Sep 10 18:34:07 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:07 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-495253fd-18ba-4db2-a889-7c22843d0de5" returned: 0 in 0.376s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Lock "cinder-quobyte-495253fd-18ba-4db2-a889-7c22843d0de5" released by "_copy_volume_from_snapshot" :: held 9.222s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:34:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Lock "cinder-quobyte-361d0176-a975-4240-8484-5b9c9f9c033e-495253fd-18ba-4db2-a889-7c22843d0de5" released by "_create_volume_from_snapshot" :: held 9.338s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:34:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.363s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:34:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a99b9d-6670-4fe7-9c23-6c14a834f2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-495253fd-18ba-4db2-a889-7c22843d0de5', 'volume_size': 1, 'snapshot_id': '361d0176-a975-4240-8484-5b9c9f9c033e'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:34:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8651c7-2945-4f73-a9e6-286e3282e7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:34:08 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Volume volume-495253fd-18ba-4db2-a889-7c22843d0de5 (495253fd-18ba-4db2-a889-7c22843d0de5): created successfully Sep 10 18:34:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8651c7-2945-4f73-a9e6-286e3282e7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:34:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Flow 'volume_create_manager' (ac0d7337-ae96-49e8-94a4-674e35acaa48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:34:08 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-1257a90f-c479-46e9-b922-bb043df775fc tempest-TestStampPattern-418652832 None] Created volume successfully. Sep 10 18:34:18 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=28,cinder:INSERT=4,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:34:18 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:UPDATE=25,cinder:SELECT=28,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:34:21 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:34:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Flow 'volume_create_manager' (875cdd9d-ac90-4e6b-8cb3-00f8789d08a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:34:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (087c6ef9-3f84-4659-9cc6-be6b847c58b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:34:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (087c6ef9-3f84-4659-9cc6-be6b847c58b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-21194912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7050f6f6-df04-4471-bb92-38e9414921e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279ca3b425cb4f089a0390b80f7e4ac5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:34:21Z,use_quota=True,user_id='af8bf67985464e3d9c7717dac091e59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:34:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7c427e-67d4-49a7-b9f7-6995bdc0cf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:34:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7c427e-67d4-49a7-b9f7-6995bdc0cf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:34:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbf51e6-d2ed-4de4-94b3-08c9f607c768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:34:21 devstack cinder-volume[87842]: DEBUG cinder.image.glance [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Creating Keystone auth plugin from conf {{(pid=87842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 18:34:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbf51e6-d2ed-4de4-94b3-08c9f607c768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7050f6f6-df04-4471-bb92-38e9414921e0', 'volume_name': 'volume-7050f6f6-df04-4471-bb92-38e9414921e0', 'volume_size': 1, 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12fe9fd924464f1896748c45b7609239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'created_at': datetime.datetime(2026, 9, 10, 16, 14, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 14, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0312d110-0baa-405f-96b9-31d6f3adc458/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:34:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445a48e9-2be5-460f-b67a-c72ec3ed81be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:34:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445a48e9-2be5-460f-b67a-c72ec3ed81be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:34:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c90cd5-c3ff-41a4-8b5f-c1271efaa916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:34:21 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Volume 7050f6f6-df04-4471-bb92-38e9414921e0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7050f6f6-df04-4471-bb92-38e9414921e0', 'volume_size': 1, 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12fe9fd924464f1896748c45b7609239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'created_at': datetime.datetime(2026, 9, 10, 16, 14, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 14, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0312d110-0baa-405f-96b9-31d6f3adc458/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 18:34:21 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Trying to clone 7050f6f6-df04-4471-bb92-38e9414921e0 from image 0312d110-0baa-405f-96b9-31d6f3adc458 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]). {{(pid=87842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 18:34:21 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_qhp0r8dudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 18:34:21 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Image download 20.69 MB at 20.69 MB/s Sep 10 18:34:21 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[171d754c-03d7-4b8e-abed-88846a942611]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:34:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_qhp0r8dudevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:22 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_qhp0r8dudevstack@QuobyteHD Sep 10 18:34:22 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:22 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_qhp0r8dudevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:22 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Temporary image 0312d110-0baa-405f-96b9-31d6f3adc458 is fetched for user af8bf67985464e3d9c7717dac091e59f. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 18:34:22 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2ebce5-703f-489a-ab03-72263d922f79]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:34:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_qhp0r8dudevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:22 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_qhp0r8dudevstack@QuobyteHD Sep 10 18:34:22 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:22 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_qhp0r8dudevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:34:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:34:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-21194912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7050f6f6-df04-4471-bb92-38e9414921e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279ca3b425cb4f089a0390b80f7e4ac5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:34:21Z,use_quota=True,user_id='af8bf67985464e3d9c7717dac091e59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:34:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Creating volume 7050f6f6-df04-4471-bb92-38e9414921e0 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:34:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:34:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:34:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:34:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:34:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:34:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:34:22 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:34:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7050f6f6-df04-4471-bb92-38e9414921e0 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:22 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7050f6f6-df04-4471-bb92-38e9414921e0 1073741824 Sep 10 18:34:22 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:23 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7050f6f6-df04-4471-bb92-38e9414921e0 1073741824" returned: 0 in 0.405s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7050f6f6-df04-4471-bb92-38e9414921e0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:23 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7050f6f6-df04-4471-bb92-38e9414921e0 Sep 10 18:34:23 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:23 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7050f6f6-df04-4471-bb92-38e9414921e0" returned: 0 in 0.254s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:34:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:34:23 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Attempting download of 0312d110-0baa-405f-96b9-31d6f3adc458 ((None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}])) to volume 7050f6f6-df04-4471-bb92-38e9414921e0. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 18:34:23 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1756c5ac-e453-4e2f-8334-471d39538bc6]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:34:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_ho31kd9m {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:23 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_ho31kd9m Sep 10 18:34:23 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:23 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_ho31kd9m" returned: 0 in 0.330s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_ho31kd9m {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:23 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_ho31kd9m Sep 10 18:34:23 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:24 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_ho31kd9m" returned: 1 in 0.355s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0312d110-0baa-405f-96b9-31d6f3adc458_ho31kd9m' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:34:24 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df2c827-da55-4030-b3c4-cdca6b412af1]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:34:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_qhp0r8dudevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:24 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_qhp0r8dudevstack@QuobyteHD Sep 10 18:34:24 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:24 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_qhp0r8dudevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:24 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] 0312d110-0baa-405f-96b9-31d6f3adc458 was qcow2, converting to qcow2 {{(pid=87842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 18:34:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_qhp0r8dudevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7050f6f6-df04-4471-bb92-38e9414921e0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:24 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_qhp0r8dudevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7050f6f6-df04-4471-bb92-38e9414921e0 Sep 10 18:34:24 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:26 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_qhp0r8dudevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7050f6f6-df04-4471-bb92-38e9414921e0" returned: 0 in 1.644s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:26 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0312d110-0baa-405f-96b9-31d6f3adc458_qhp0r8dudevstack@QuobyteHD, size 112.00 MB, duration 1.65 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7050f6f6-df04-4471-bb92-38e9414921e0 {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:34:26 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Converted 112.00 MB image at 68.04 MB/s Sep 10 18:34:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7050f6f6-df04-4471-bb92-38e9414921e0 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:26 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7050f6f6-df04-4471-bb92-38e9414921e0 1G Sep 10 18:34:26 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:26 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7050f6f6-df04-4471-bb92-38e9414921e0 1G" returned: 0 in 0.305s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:26 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Downloaded image 0312d110-0baa-405f-96b9-31d6f3adc458 ((None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}])) to volume 7050f6f6-df04-4471-bb92-38e9414921e0 successfully. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 18:34:26 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Temporary image 0312d110-0baa-405f-96b9-31d6f3adc458 for user af8bf67985464e3d9c7717dac091e59f is deleted. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 18:34:26 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Marking volume 7050f6f6-df04-4471-bb92-38e9414921e0 as bootable. {{(pid=87842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 18:34:26 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Copying metadata from image 0312d110-0baa-405f-96b9-31d6f3adc458 to 7050f6f6-df04-4471-bb92-38e9414921e0. {{(pid=87842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 18:34:26 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Creating volume glance metadata for volume 7050f6f6-df04-4471-bb92-38e9414921e0 backed by image 0312d110-0baa-405f-96b9-31d6f3adc458 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 18:34:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c90cd5-c3ff-41a4-8b5f-c1271efaa916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7050f6f6-df04-4471-bb92-38e9414921e0', 'volume_size': 1, 'image_id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0312d110-0baa-405f-96b9-31d6f3adc458', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12fe9fd924464f1896748c45b7609239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0312d110-0baa-405f-96b9-31d6f3adc458', 'created_at': datetime.datetime(2026, 9, 10, 16, 14, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 14, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0312d110-0baa-405f-96b9-31d6f3adc458/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:34:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97958414-a74b-49f9-811f-d4305d878794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:34:26 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Volume volume-7050f6f6-df04-4471-bb92-38e9414921e0 (7050f6f6-df04-4471-bb92-38e9414921e0): created successfully Sep 10 18:34:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97958414-a74b-49f9-811f-d4305d878794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:34:26 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Flow 'volume_create_manager' (875cdd9d-ac90-4e6b-8cb3-00f8789d08a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:34:26 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-70468347-56a9-4b97-acc6-6dc97a0059ab tempest-TestShelveInstance-2077717959 None] Created volume successfully. Sep 10 18:34:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:34:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:34:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:34:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:34:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:34:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:34:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:29 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:34:29 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:29 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.258s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:34:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:34:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 28 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:34:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:34:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-db4e3042-83ef-49a0-a405-77a267e32127 req-d83f6918-b293-47d1-82c7-e88349a066cb tempest-TestShelveInstance-2077717959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:34:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-db4e3042-83ef-49a0-a405-77a267e32127 req-d83f6918-b293-47d1-82c7-e88349a066cb tempest-TestShelveInstance-2077717959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:34:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-db4e3042-83ef-49a0-a405-77a267e32127 req-d83f6918-b293-47d1-82c7-e88349a066cb tempest-TestShelveInstance-2077717959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:34:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-db4e3042-83ef-49a0-a405-77a267e32127 req-d83f6918-b293-47d1-82c7-e88349a066cb tempest-TestShelveInstance-2077717959 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-7050f6f6-df04-4471-bb92-38e9414921e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ee58047-b20e-448c-b471-6f36298f1c28', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:34:29 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-db4e3042-83ef-49a0-a405-77a267e32127 req-d83f6918-b293-47d1-82c7-e88349a066cb tempest-TestShelveInstance-2077717959 None] attachment_update completed successfully. Sep 10 18:34:33 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-6bc1aa76-f26a-46ea-8b88-63a4e3e18208 req-b0b7467c-9295-4328-ab4a-2c5ae0e63f2c tempest-TestMinimumBasicScenario-450204744 None] Terminate volume connection completed successfully. Sep 10 18:34:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-6bc1aa76-f26a-46ea-8b88-63a4e3e18208 req-b0b7467c-9295-4328-ab4a-2c5ae0e63f2c tempest-TestMinimumBasicScenario-450204744 None] Deleting attachment 0133d0d4-2b9d-4614-8f1c-1852437cf5a7. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:34:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] Acquiring lock "cinder-be2edd56-b5d6-4585-a555-10aa4d1867c6-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:34:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] Lock "cinder-be2edd56-b5d6-4585-a555-10aa4d1867c6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:34:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] Acquiring lock "cinder-quobyte-be2edd56-b5d6-4585-a555-10aa4d1867c6" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:34:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] Lock "cinder-quobyte-be2edd56-b5d6-4585-a555-10aa4d1867c6" acquired by "delete_volume" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:34:34 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[966f150d-c5db-427f-a6ae-cf1e7a811dcc]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:34:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-be2edd56-b5d6-4585-a555-10aa4d1867c6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:34 devstack sudo[103660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-be2edd56-b5d6-4585-a555-10aa4d1867c6 Sep 10 18:34:34 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:34 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-be2edd56-b5d6-4585-a555-10aa4d1867c6" returned: 0 in 0.534s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-be2edd56-b5d6-4585-a555-10aa4d1867c6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:34 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-be2edd56-b5d6-4585-a555-10aa4d1867c6 Sep 10 18:34:34 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:34 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-be2edd56-b5d6-4585-a555-10aa4d1867c6" returned: 0 in 0.294s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] Lock "cinder-quobyte-be2edd56-b5d6-4585-a555-10aa4d1867c6" released by "delete_volume" :: held 0.887s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:34:35 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] Created reservations ['a1bdf291-35ad-47c3-ba12-1054960fb98f', '1040d5e9-22a7-4536-ba55-cad7af868bcf', '27200015-b509-4725-8803-ebc38bb93efc', '2f9ec2ba-b42a-45d4-acfd-65aed6982699'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:34:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:34:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:34:35 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:34:35 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:34:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:34:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:35 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:34:35 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:35 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.366s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:35 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:34:35 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] Deleted volume successfully. Sep 10 18:34:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-85beee42-c209-4ea1-aa41-ac4c8d24a478 tempest-TestMinimumBasicScenario-450204744 None] Lock "cinder-be2edd56-b5d6-4585-a555-10aa4d1867c6-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:34:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-6d4e8f9d-7795-4fc7-bb28-f402c19d3381 req-049cb1c7-fe78-4106-98f3-705109294aa2 tempest-TestStampPattern-418652832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:34:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-6d4e8f9d-7795-4fc7-bb28-f402c19d3381 req-049cb1c7-fe78-4106-98f3-705109294aa2 tempest-TestStampPattern-418652832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:34:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-6d4e8f9d-7795-4fc7-bb28-f402c19d3381 req-049cb1c7-fe78-4106-98f3-705109294aa2 tempest-TestStampPattern-418652832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:34:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-6d4e8f9d-7795-4fc7-bb28-f402c19d3381 req-049cb1c7-fe78-4106-98f3-705109294aa2 tempest-TestStampPattern-418652832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-495253fd-18ba-4db2-a889-7c22843d0de5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68bb5bc1-26e4-414f-8ccf-9adb4b9a338f', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:34:40 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-6d4e8f9d-7795-4fc7-bb28-f402c19d3381 req-049cb1c7-fe78-4106-98f3-705109294aa2 tempest-TestStampPattern-418652832 None] attachment_update completed successfully. Sep 10 18:34:43 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-97d96f1e-943f-4027-a199-d8f71dd33663 req-deebb201-7e2f-4202-9bb4-7c40e07de3ca tempest-TestStampPattern-418652832 None] Terminate volume connection completed successfully. Sep 10 18:34:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-97d96f1e-943f-4027-a199-d8f71dd33663 req-deebb201-7e2f-4202-9bb4-7c40e07de3ca tempest-TestStampPattern-418652832 None] Deleting attachment 68bb5bc1-26e4-414f-8ccf-9adb4b9a338f. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:34:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] Acquiring lock "cinder-495253fd-18ba-4db2-a889-7c22843d0de5-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:34:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] Lock "cinder-495253fd-18ba-4db2-a889-7c22843d0de5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:34:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] Acquiring lock "cinder-quobyte-495253fd-18ba-4db2-a889-7c22843d0de5" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:34:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] Lock "cinder-quobyte-495253fd-18ba-4db2-a889-7c22843d0de5" acquired by "delete_volume" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:34:48 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a052354-a07a-423e-8032-a24b8e8664d4]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:34:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-495253fd-18ba-4db2-a889-7c22843d0de5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:48 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-495253fd-18ba-4db2-a889-7c22843d0de5 Sep 10 18:34:48 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:48 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-495253fd-18ba-4db2-a889-7c22843d0de5" returned: 0 in 0.408s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-495253fd-18ba-4db2-a889-7c22843d0de5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:48 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-495253fd-18ba-4db2-a889-7c22843d0de5 Sep 10 18:34:48 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:49 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-495253fd-18ba-4db2-a889-7c22843d0de5" returned: 0 in 0.287s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] Lock "cinder-quobyte-495253fd-18ba-4db2-a889-7c22843d0de5" released by "delete_volume" :: held 0.767s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] Created reservations ['45e0b03a-2385-4b55-af2a-a306a61e6c80', '1a2aefe7-8ffd-4d25-bb7d-29fe5a2861a5', '5c1ba793-5d9c-42a7-b6a8-1926eaea9a01', '0e68f7ce-b556-41a7-b77a-99e94c13d181'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:49 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:34:49 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:49 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.275s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:34:49 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] Deleted volume successfully. Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-69bf7e87-a09f-403a-a1d5-d63a72ece6eb tempest-TestStampPattern-418652832 None] Lock "cinder-495253fd-18ba-4db2-a889-7c22843d0de5-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] Acquiring lock "cinder-361d0176-a975-4240-8484-5b9c9f9c033e-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] Lock "cinder-361d0176-a975-4240-8484-5b9c9f9c033e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] Acquiring lock "cinder-quobyte-4d140238-c52a-483a-bee9-a9df0651fd8a" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] Lock "cinder-quobyte-4d140238-c52a-483a-bee9-a9df0651fd8a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] Acquiring lock "cinder-quobyte-361d0176-a975-4240-8484-5b9c9f9c033e" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] Lock "cinder-quobyte-361d0176-a975-4240-8484-5b9c9f9c033e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] Deleting offline snapshot 361d0176-a975-4240-8484-5b9c9f9c033e of volume 4d140238-c52a-483a-bee9-a9df0651fd8a {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] snapshot_file for this snap is: volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[12931a01-742e-4cda-870b-79ce3ae1250f]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:34:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:50 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e Sep 10 18:34:50 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:50 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e" returned: 0 in 0.497s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d140238-c52a-483a-bee9-a9df0651fd8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:34:50 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6652e2-0645-4450-b066-1604e253f407]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:34:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:50 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a Sep 10 18:34:50 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:51 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a" returned: 0 in 0.630s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:51 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e Sep 10 18:34:51 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:51 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e" returned: 0 in 0.415s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:51 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e Sep 10 18:34:51 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:51 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a.361d0176-a975-4240-8484-5b9c9f9c033e" returned: 0 in 0.250s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] Lock "cinder-quobyte-361d0176-a975-4240-8484-5b9c9f9c033e" released by "_delete_snapshot" :: held 1.911s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:34:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] Lock "cinder-quobyte-4d140238-c52a-483a-bee9-a9df0651fd8a" released by "delete_snapshot" :: held 1.948s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:34:51 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] Created reservations ['65b42860-66d4-4c53-aca4-6849fd77f225', '9ee8ecbb-2f49-4539-ae83-3e67b831ace5', '60548530-8e58-4cf3-a488-7bb6940e8ab5', '1e884a60-02ac-4f3f-95cc-750a7a22ab50'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:34:51 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] Delete snapshot completed successfully. Sep 10 18:34:52 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-77da6acc-faac-4b59-afa7-ea28ed7187d1 tempest-TestStampPattern-418652832 None] Lock "cinder-361d0176-a975-4240-8484-5b9c9f9c033e-delete_snapshot" released by "delete_snapshot" :: held 2.111s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:34:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] Acquiring lock "cinder-4d140238-c52a-483a-bee9-a9df0651fd8a-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:34:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] Lock "cinder-4d140238-c52a-483a-bee9-a9df0651fd8a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:34:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] Acquiring lock "cinder-quobyte-4d140238-c52a-483a-bee9-a9df0651fd8a" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:34:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] Lock "cinder-quobyte-4d140238-c52a-483a-bee9-a9df0651fd8a" acquired by "delete_volume" :: waited 0.018s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:34:55 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b30525-42fb-4613-ac5c-2155f3d3718a]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:34:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:55 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a Sep 10 18:34:55 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:56 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a" returned: 0 in 0.386s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:56 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a Sep 10 18:34:56 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:56 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d140238-c52a-483a-bee9-a9df0651fd8a" returned: 0 in 0.261s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:56 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] Lock "cinder-quobyte-4d140238-c52a-483a-bee9-a9df0651fd8a" released by "delete_volume" :: held 0.713s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:34:56 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] Created reservations ['22f338e3-a94c-491a-bf20-2b9166610140', '1e11b2b0-e870-4d44-a0a4-d7110cd4b922', 'c7ac86ed-58f2-46f5-adbc-3fc9ee6df8e1', '1daf5787-b7cd-4afb-8d01-431cb74fd8d9'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:34:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:34:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:34:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:34:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:34:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:34:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:34:56 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:34:56 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:34:56 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Sep 10 18:34:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.290s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:34:56 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:34:56 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] Deleted volume successfully. Sep 10 18:34:56 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-79b8275f-47d5-40a0-893a-223f65747bb8 tempest-TestStampPattern-418652832 None] Lock "cinder-4d140238-c52a-483a-bee9-a9df0651fd8a-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:35:08 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-943c5e62-a164-40a2-a19b-8c001c2fc6ce req-8ec23870-1f02-40e7-96c6-589269b384e1 tempest-TestShelveInstance-2077717959 None] Terminate volume connection completed successfully. Sep 10 18:35:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-943c5e62-a164-40a2-a19b-8c001c2fc6ce req-8ec23870-1f02-40e7-96c6-589269b384e1 tempest-TestShelveInstance-2077717959 None] Deleting attachment 4ee58047-b20e-448c-b471-6f36298f1c28. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:35:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-144d3b7c-6f8a-49e7-abfe-94ee04f9ef8f req-82a5811c-e4a2-46f9-9c9f-67cb01da773d tempest-TestShelveInstance-2077717959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-144d3b7c-6f8a-49e7-abfe-94ee04f9ef8f req-82a5811c-e4a2-46f9-9c9f-67cb01da773d tempest-TestShelveInstance-2077717959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-144d3b7c-6f8a-49e7-abfe-94ee04f9ef8f req-82a5811c-e4a2-46f9-9c9f-67cb01da773d tempest-TestShelveInstance-2077717959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-144d3b7c-6f8a-49e7-abfe-94ee04f9ef8f req-82a5811c-e4a2-46f9-9c9f-67cb01da773d tempest-TestShelveInstance-2077717959 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14', 'name': 'volume-7050f6f6-df04-4471-bb92-38e9414921e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '187b0dcb-dcba-46ae-99d0-c88b3c477427', 'enforce_multipath': True} {{(pid=87842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 10 18:35:12 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-144d3b7c-6f8a-49e7-abfe-94ee04f9ef8f req-82a5811c-e4a2-46f9-9c9f-67cb01da773d tempest-TestShelveInstance-2077717959 None] attachment_update completed successfully. Sep 10 18:35:15 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:35:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Flow 'volume_create_manager' (75364678-845f-4698-b74a-3b9730bab46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:35:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f482771-954a-490d-85f3-3192c97c875b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f482771-954a-490d-85f3-3192c97c875b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3adbfc2-b82d-4991-b730-abd3268167b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3f6de42a534e2c97d6cd73254a4c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:35:16Z,use_quota=True,user_id='7afaf03ab12b455a94c08140c64bb327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bafa4068-28cf-4752-ac46-042a0bd329c7),volume_type_id=bafa4068-28cf-4752-ac46-042a0bd329c7)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ffee4c-e23f-446f-b43a-009300b95a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ffee4c-e23f-446f-b43a-009300b95a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d077f547-c17b-405b-9132-a76255b8a4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:16 devstack cinder-volume[87842]: DEBUG cinder.image.glance [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Creating Keystone auth plugin from conf {{(pid=87842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 18:35:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d077f547-c17b-405b-9132-a76255b8a4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c3adbfc2-b82d-4991-b730-abd3268167b9', 'volume_name': 'volume-c3adbfc2-b82d-4991-b730-abd3268167b9', 'volume_size': 1, 'image_id': '46e10225-e59a-4123-b0b1-75ee9f0fbe66', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46e10225-e59a-4123-b0b1-75ee9f0fbe66', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '18442a2f747736c27f25a0b4dea43810', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7e3f6de42a534e2c97d6cd73254a4c75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2aa59bd78e1779b35fa512358aa2ccd54553b02d6e4e4910a68337bcbc7bf4fc4f1a58965a39efebdba32e8b730783b8b68b5c0a94f0d43b166aff987daf602c', 'id': '46e10225-e59a-4123-b0b1-75ee9f0fbe66', 'created_at': datetime.datetime(2026, 9, 10, 16, 35, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 35, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46e10225-e59a-4123-b0b1-75ee9f0fbe66/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb769d8f-7c48-4657-94c3-3839ad11039c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb769d8f-7c48-4657-94c3-3839ad11039c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da9d4c3-5193-4414-8626-95612d3ecb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:16 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Volume c3adbfc2-b82d-4991-b730-abd3268167b9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c3adbfc2-b82d-4991-b730-abd3268167b9', 'volume_size': 1, 'image_id': '46e10225-e59a-4123-b0b1-75ee9f0fbe66', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46e10225-e59a-4123-b0b1-75ee9f0fbe66', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '18442a2f747736c27f25a0b4dea43810', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7e3f6de42a534e2c97d6cd73254a4c75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2aa59bd78e1779b35fa512358aa2ccd54553b02d6e4e4910a68337bcbc7bf4fc4f1a58965a39efebdba32e8b730783b8b68b5c0a94f0d43b166aff987daf602c', 'id': '46e10225-e59a-4123-b0b1-75ee9f0fbe66', 'created_at': datetime.datetime(2026, 9, 10, 16, 35, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 35, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46e10225-e59a-4123-b0b1-75ee9f0fbe66/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 10 18:35:16 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Trying to clone c3adbfc2-b82d-4991-b730-abd3268167b9 from image 46e10225-e59a-4123-b0b1-75ee9f0fbe66 at location (None, [{'url': 'file:///opt/stack/data/glance/images/46e10225-e59a-4123-b0b1-75ee9f0fbe66', 'metadata': {}}]). {{(pid=87842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 18:35:16 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 18:35:16 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Image download 0.00 MB at 0.00 MB/s Sep 10 18:35:16 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0e2a64-3055-4f70-a40b-0b67af76303d]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:35:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:17 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD Sep 10 18:35:17 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:17 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:17 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD Sep 10 18:35:17 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:17 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD" returned: 1 in 0.387s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:35:17 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Temporary image 46e10225-e59a-4123-b0b1-75ee9f0fbe66 is fetched for user 7afaf03ab12b455a94c08140c64bb327. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 18:35:17 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7a7204-785c-4b65-b98a-e3b159d931da]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:35:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:18 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD Sep 10 18:35:18 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:18 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:18 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD Sep 10 18:35:18 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:18 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD" returned: 1 in 0.442s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:35:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3adbfc2-b82d-4991-b730-abd3268167b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3f6de42a534e2c97d6cd73254a4c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:35:16Z,use_quota=True,user_id='7afaf03ab12b455a94c08140c64bb327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bafa4068-28cf-4752-ac46-042a0bd329c7),volume_type_id=bafa4068-28cf-4752-ac46-042a0bd329c7)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:35:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Creating volume c3adbfc2-b82d-4991-b730-abd3268167b9 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:35:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:35:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:35:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:35:18 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:35:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3adbfc2-b82d-4991-b730-abd3268167b9 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:18 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3adbfc2-b82d-4991-b730-abd3268167b9 1073741824 Sep 10 18:35:18 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:19 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3adbfc2-b82d-4991-b730-abd3268167b9 1073741824" returned: 0 in 0.736s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:19 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=56,cinder:UPDATE=40,cinder:INSERT=15,cinder:DELETE=1 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:35:19 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=55,cinder:INSERT=16,cinder:UPDATE=40,cinder:DELETE=3 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:35:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3adbfc2-b82d-4991-b730-abd3268167b9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:19 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3adbfc2-b82d-4991-b730-abd3268167b9 Sep 10 18:35:19 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:20 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3adbfc2-b82d-4991-b730-abd3268167b9" returned: 0 in 0.579s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:35:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:20 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Attempting download of 46e10225-e59a-4123-b0b1-75ee9f0fbe66 ((None, [{'url': 'file:///opt/stack/data/glance/images/46e10225-e59a-4123-b0b1-75ee9f0fbe66', 'metadata': {}}])) to volume c3adbfc2-b82d-4991-b730-abd3268167b9. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 18:35:20 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[60355bba-3373-428d-9bf7-54f807139b80]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:35:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46e10225-e59a-4123-b0b1-75ee9f0fbe66_zzgh8esd {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:20 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46e10225-e59a-4123-b0b1-75ee9f0fbe66_zzgh8esd Sep 10 18:35:20 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:20 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46e10225-e59a-4123-b0b1-75ee9f0fbe66_zzgh8esd" returned: 0 in 0.450s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46e10225-e59a-4123-b0b1-75ee9f0fbe66_zzgh8esd {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:20 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46e10225-e59a-4123-b0b1-75ee9f0fbe66_zzgh8esd Sep 10 18:35:20 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:21 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46e10225-e59a-4123-b0b1-75ee9f0fbe66_zzgh8esd" returned: 1 in 0.575s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46e10225-e59a-4123-b0b1-75ee9f0fbe66_zzgh8esd' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c93e9ef-60df-4994-87c4-6a4564090070]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Flow 'volume_create_manager' (a9fcb796-de8b-41e7-8d9b-2aac457ab512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4e868a8-4de6-4a8c-80a0-3d7f295031d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:21 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD Sep 10 18:35:21 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4e868a8-4de6-4a8c-80a0-3d7f295031d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1196710991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4baba96c-febf-412e-9588-5d4c0ff4f362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='006ac8c5c87a432593bca749dc849752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:35:21Z,use_quota=True,user_id='90c4f71fd8e14acb995ec3a21df81aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec6548d-9cf7-4d97-90ac-9f846d41f7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec6548d-9cf7-4d97-90ac-9f846d41f7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50614e7-f8a9-4170-8206-47053174d9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50614e7-f8a9-4170-8206-47053174d9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4baba96c-febf-412e-9588-5d4c0ff4f362', 'volume_name': 'volume-4baba96c-febf-412e-9588-5d4c0ff4f362', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7f6aed-242d-44f2-801e-32223e8c6d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7f6aed-242d-44f2-801e-32223e8c6d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5eec723-fe75-42e4-85be-286b39fe91cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:21 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Volume 4baba96c-febf-412e-9588-5d4c0ff4f362: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4baba96c-febf-412e-9588-5d4c0ff4f362', 'volume_size': 1} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1196710991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4baba96c-febf-412e-9588-5d4c0ff4f362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='006ac8c5c87a432593bca749dc849752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:35:21Z,use_quota=True,user_id='90c4f71fd8e14acb995ec3a21df81aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Creating volume 4baba96c-febf-412e-9588-5d4c0ff4f362 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:35:21 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:21 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362 1073741824 Sep 10 18:35:21 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:21 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:21 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD Sep 10 18:35:21 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:21 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362 1073741824" returned: 0 in 0.466s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:22 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362 Sep 10 18:35:22 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:22 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD" returned: 1 in 0.408s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] 46e10225-e59a-4123-b0b1-75ee9f0fbe66 was raw, converting to qcow2 {{(pid=87842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3adbfc2-b82d-4991-b730-abd3268167b9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:22 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3adbfc2-b82d-4991-b730-abd3268167b9 Sep 10 18:35:22 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:22 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362" returned: 0 in 0.303s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5eec723-fe75-42e4-85be-286b39fe91cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4baba96c-febf-412e-9588-5d4c0ff4f362', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67e66ab-bf02-4886-b63f-0a1cbaef044d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:22 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Volume volume-4baba96c-febf-412e-9588-5d4c0ff4f362 (4baba96c-febf-412e-9588-5d4c0ff4f362): created successfully Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67e66ab-bf02-4886-b63f-0a1cbaef044d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Flow 'volume_create_manager' (a9fcb796-de8b-41e7-8d9b-2aac457ab512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:35:22 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-6ea4b411-98bb-4acd-b98c-cd280ade0478 tempest-TestImageHashVerification-1387479123 None] Created volume successfully. Sep 10 18:35:22 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3adbfc2-b82d-4991-b730-abd3268167b9" returned: 0 in 0.536s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_46e10225-e59a-4123-b0b1-75ee9f0fbe66_qj1d0eqsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3adbfc2-b82d-4991-b730-abd3268167b9 {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:35:22 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3adbfc2-b82d-4991-b730-abd3268167b9 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:22 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3adbfc2-b82d-4991-b730-abd3268167b9 1G Sep 10 18:35:22 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:22 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3adbfc2-b82d-4991-b730-abd3268167b9 1G" returned: 0 in 0.318s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Downloaded image 46e10225-e59a-4123-b0b1-75ee9f0fbe66 ((None, [{'url': 'file:///opt/stack/data/glance/images/46e10225-e59a-4123-b0b1-75ee9f0fbe66', 'metadata': {}}])) to volume c3adbfc2-b82d-4991-b730-abd3268167b9 successfully. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Temporary image 46e10225-e59a-4123-b0b1-75ee9f0fbe66 for user 7afaf03ab12b455a94c08140c64bb327 is deleted. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Marking volume c3adbfc2-b82d-4991-b730-abd3268167b9 as bootable. {{(pid=87842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Copying metadata from image 46e10225-e59a-4123-b0b1-75ee9f0fbe66 to c3adbfc2-b82d-4991-b730-abd3268167b9. {{(pid=87842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Creating volume glance metadata for volume c3adbfc2-b82d-4991-b730-abd3268167b9 backed by image 46e10225-e59a-4123-b0b1-75ee9f0fbe66 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '46e10225-e59a-4123-b0b1-75ee9f0fbe66', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '18442a2f747736c27f25a0b4dea43810', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da9d4c3-5193-4414-8626-95612d3ecb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3adbfc2-b82d-4991-b730-abd3268167b9', 'volume_size': 1, 'image_id': '46e10225-e59a-4123-b0b1-75ee9f0fbe66', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46e10225-e59a-4123-b0b1-75ee9f0fbe66', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '18442a2f747736c27f25a0b4dea43810', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7e3f6de42a534e2c97d6cd73254a4c75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2aa59bd78e1779b35fa512358aa2ccd54553b02d6e4e4910a68337bcbc7bf4fc4f1a58965a39efebdba32e8b730783b8b68b5c0a94f0d43b166aff987daf602c', 'id': '46e10225-e59a-4123-b0b1-75ee9f0fbe66', 'created_at': datetime.datetime(2026, 9, 10, 16, 35, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 35, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46e10225-e59a-4123-b0b1-75ee9f0fbe66/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:22 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5975bfa-ef17-4dd2-86b2-87aa947e0798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:23 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Volume volume-c3adbfc2-b82d-4991-b730-abd3268167b9 (c3adbfc2-b82d-4991-b730-abd3268167b9): created successfully Sep 10 18:35:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5975bfa-ef17-4dd2-86b2-87aa947e0798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:23 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Flow 'volume_create_manager' (75364678-845f-4698-b74a-3b9730bab46c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:35:23 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-20d1f9f9-a3a5-433e-93f6-13faec0299a6 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Created volume successfully. Sep 10 18:35:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Acquiring lock "cinder-c3adbfc2-b82d-4991-b730-abd3268167b9-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:35:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Lock "cinder-c3adbfc2-b82d-4991-b730-abd3268167b9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:35:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Acquiring lock "cinder-quobyte-c3adbfc2-b82d-4991-b730-abd3268167b9" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:35:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Lock "cinder-quobyte-c3adbfc2-b82d-4991-b730-abd3268167b9" acquired by "delete_volume" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:35:23 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8197ab5d-9844-49df-b0f2-7ad21d5ebb58]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:35:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3adbfc2-b82d-4991-b730-abd3268167b9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:23 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3adbfc2-b82d-4991-b730-abd3268167b9 Sep 10 18:35:23 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:23 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3adbfc2-b82d-4991-b730-abd3268167b9" returned: 0 in 0.385s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3adbfc2-b82d-4991-b730-abd3268167b9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:23 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3adbfc2-b82d-4991-b730-abd3268167b9 Sep 10 18:35:23 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:24 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3adbfc2-b82d-4991-b730-abd3268167b9" returned: 0 in 0.278s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f16e1097-f277-46fe-b8da-ff89f33cc87b tempest-TestImageHashVerification-1387479123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f16e1097-f277-46fe-b8da-ff89f33cc87b tempest-TestImageHashVerification-1387479123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:24 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Lock "cinder-quobyte-c3adbfc2-b82d-4991-b730-abd3268167b9" released by "delete_volume" :: held 0.728s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:35:24 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1ef13e-b17f-4d6d-bb07-24aa4a1e7dc1]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:35:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f16e1097-f277-46fe-b8da-ff89f33cc87b tempest-TestImageHashVerification-1387479123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:24 devstack cinder-volume[87842]: WARNING cinder.quota [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:35:24 devstack cinder-volume[87842]: WARNING cinder.quota [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 10 18:35:24 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Created reservations ['fb82bd64-4e9b-45f6-8b2f-b525388e1332', 'd06b7fe1-588a-4820-b0e8-cbe5be87a123', 'd331f3f0-8e91-44e0-9aef-01122858b6c5', '4a4d2938-5871-4338-a4e6-b615257130cb'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:35:24 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362 Sep 10 18:35:24 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:24 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:35:24 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:35:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:24 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:35:24 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:24 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:24 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.291s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:24 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:35:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f16e1097-f277-46fe-b8da-ff89f33cc87b tempest-TestImageHashVerification-1387479123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362" returned: 0 in 0.429s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:24 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Deleted volume successfully. Sep 10 18:35:24 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c9a133-a963-49b3-89e8-e14573b10038]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:35:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f16e1097-f277-46fe-b8da-ff89f33cc87b tempest-TestImageHashVerification-1387479123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:24 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-972b5ea6-af6d-4661-b279-4f5c4d7426d7 tempest-VolumeAndVolumeTypeFromImageTest-2063711688 None] Lock "cinder-c3adbfc2-b82d-4991-b730-abd3268167b9-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:35:24 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362 Sep 10 18:35:24 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:25 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f16e1097-f277-46fe-b8da-ff89f33cc87b tempest-TestImageHashVerification-1387479123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362" returned: 0 in 0.408s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f16e1097-f277-46fe-b8da-ff89f33cc87b tempest-TestImageHashVerification-1387479123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362 /opt/stack/data/cinder/conversion/4baba96c-febf-412e-9588-5d4c0ff4f362.temp_image.e4d6cf6a-ab8d-4d53-9b3a-80a3c2d9f22adq82n671.img {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:25 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362 /opt/stack/data/cinder/conversion/4baba96c-febf-412e-9588-5d4c0ff4f362.temp_image.e4d6cf6a-ab8d-4d53-9b3a-80a3c2d9f22adq82n671.img Sep 10 18:35:25 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:35:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:35:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:35:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:29 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:35:29 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:29 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.733s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:35:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:35:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 28 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:35:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:35:30 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f16e1097-f277-46fe-b8da-ff89f33cc87b tempest-TestImageHashVerification-1387479123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362 /opt/stack/data/cinder/conversion/4baba96c-febf-412e-9588-5d4c0ff4f362.temp_image.e4d6cf6a-ab8d-4d53-9b3a-80a3c2d9f22adq82n671.img" returned: 0 in 5.310s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:30 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ba34a6-9ac6-42eb-8920-39f4181fa4f8]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:35:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f16e1097-f277-46fe-b8da-ff89f33cc87b tempest-TestImageHashVerification-1387479123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:30 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362 Sep 10 18:35:30 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:30 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f16e1097-f277-46fe-b8da-ff89f33cc87b tempest-TestImageHashVerification-1387479123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362" returned: 0 in 0.605s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:30 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-f16e1097-f277-46fe-b8da-ff89f33cc87b tempest-TestImageHashVerification-1387479123 None] Image conversion details: src /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362, size 1024.00 MB, duration 5.31 sec, destination /opt/stack/data/cinder/conversion/4baba96c-febf-412e-9588-5d4c0ff4f362.temp_image.e4d6cf6a-ab8d-4d53-9b3a-80a3c2d9f22adq82n671.img {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:35:30 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-f16e1097-f277-46fe-b8da-ff89f33cc87b tempest-TestImageHashVerification-1387479123 None] Converted 1024.00 MB image at 192.79 MB/s Sep 10 18:35:30 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-f16e1097-f277-46fe-b8da-ff89f33cc87b tempest-TestImageHashVerification-1387479123 None] e4d6cf6a-ab8d-4d53-9b3a-80a3c2d9f22a was raw, no need to convert to raw {{(pid=87842) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 10 18:35:32 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:35:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Flow 'volume_create_manager' (11d91642-4baf-4da6-9ed1-b042e0acd61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:35:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884cd495-c12b-41cf-865b-12c74a0ceef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884cd495-c12b-41cf-865b-12c74a0ceef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-489305126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0942bf67-52d3-4969-97ca-5d8b5e72f7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c1d06fdfaa44428b377a8e811b0f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:35:32Z,use_quota=True,user_id='c1eca5fa48fe46b6b6c0e5e21794dc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2130e39d-3c07-4d1a-a3c3-03dae3b25e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2130e39d-3c07-4d1a-a3c3-03dae3b25e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea35478-d3cf-44eb-ac65-258ea0255e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea35478-d3cf-44eb-ac65-258ea0255e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0942bf67-52d3-4969-97ca-5d8b5e72f7bc', 'volume_name': 'volume-0942bf67-52d3-4969-97ca-5d8b5e72f7bc', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bc2286-a8c4-4213-8e3d-ee4dfd392ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bc2286-a8c4-4213-8e3d-ee4dfd392ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2151302-b8ae-4723-adfd-d6468f565565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:32 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Volume 0942bf67-52d3-4969-97ca-5d8b5e72f7bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0942bf67-52d3-4969-97ca-5d8b5e72f7bc', 'volume_size': 1} Sep 10 18:35:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Flow 'volume_create_manager' (c1bb0136-c5f0-4261-92d5-c9e0405f56f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5c6943-f878-42ab-b7b6-0fc34b56b501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5c6943-f878-42ab-b7b6-0fc34b56b501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-461165276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3752645-d889-47a9-9c4c-cc8f8f1710a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c1d06fdfaa44428b377a8e811b0f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:35:33Z,use_quota=True,user_id='c1eca5fa48fe46b6b6c0e5e21794dc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0d6553-a1cc-4578-bddf-5d2746fdb87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0d6553-a1cc-4578-bddf-5d2746fdb87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bdbfe03-80fd-487b-b5de-342b246ce375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bdbfe03-80fd-487b-b5de-342b246ce375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3752645-d889-47a9-9c4c-cc8f8f1710a2', 'volume_name': 'volume-f3752645-d889-47a9-9c4c-cc8f8f1710a2', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2fe9a3-676e-411d-9dce-8f88b5e0d342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2fe9a3-676e-411d-9dce-8f88b5e0d342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0618232a-ce81-4f9e-b796-a06789d0755e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:33 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Volume f3752645-d889-47a9-9c4c-cc8f8f1710a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3752645-d889-47a9-9c4c-cc8f8f1710a2', 'volume_size': 1} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Flow 'volume_create_manager' (797d4a21-6815-4e9e-9d5b-77b5e686088c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e524c8-df92-48ad-aeee-0c2f9aefaeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e524c8-df92-48ad-aeee-0c2f9aefaeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1858546656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639ed887-b639-496f-875d-3e824e3a5520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c1d06fdfaa44428b377a8e811b0f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:35:34Z,use_quota=True,user_id='c1eca5fa48fe46b6b6c0e5e21794dc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e95b2b-ff22-4daa-a6ef-c0253b0aad3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e95b2b-ff22-4daa-a6ef-c0253b0aad3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4242d9ac-ff8f-4c54-9def-b32764791f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4242d9ac-ff8f-4c54-9def-b32764791f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '639ed887-b639-496f-875d-3e824e3a5520', 'volume_name': 'volume-639ed887-b639-496f-875d-3e824e3a5520', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f5d86c-f850-4514-9d03-3b3102eb472f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f5d86c-f850-4514-9d03-3b3102eb472f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bfa6a6-4493-4350-baab-04dc10515455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:33 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Volume 639ed887-b639-496f-875d-3e824e3a5520: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-639ed887-b639-496f-875d-3e824e3a5520', 'volume_size': 1} Sep 10 18:35:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Flow 'volume_create_manager' (be40cfb7-ba58-4cd0-804e-73b2ec1d3b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11906577-1423-4f3c-b6d7-2c0d240e1ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11906577-1423-4f3c-b6d7-2c0d240e1ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-887599221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30448344-4713-4228-9a07-461caa96bb58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c1d06fdfaa44428b377a8e811b0f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:35:34Z,use_quota=True,user_id='c1eca5fa48fe46b6b6c0e5e21794dc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576a9049-ec80-40b4-82e1-17c42b24fb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576a9049-ec80-40b4-82e1-17c42b24fb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70900147-4f5b-44dc-94f7-d4d4af6d2b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70900147-4f5b-44dc-94f7-d4d4af6d2b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30448344-4713-4228-9a07-461caa96bb58', 'volume_name': 'volume-30448344-4713-4228-9a07-461caa96bb58', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103edc00-3687-46a8-ab1c-29d385ea3c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103edc00-3687-46a8-ab1c-29d385ea3c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3711423d-7860-4701-8670-4ea3489f2ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:34 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Volume 30448344-4713-4228-9a07-461caa96bb58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30448344-4713-4228-9a07-461caa96bb58', 'volume_size': 1} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Flow 'volume_create_manager' (868abcfb-8a66-490b-be7e-7dc6126b66d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af32707-ab88-4bdd-a5ee-50aef69fdf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af32707-ab88-4bdd-a5ee-50aef69fdf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-622380363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1272981b-e72c-4b10-a061-74c532b3e897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c1d06fdfaa44428b377a8e811b0f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:35:34Z,use_quota=True,user_id='c1eca5fa48fe46b6b6c0e5e21794dc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75216043-98bf-48a8-8e2a-49f9586bd734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75216043-98bf-48a8-8e2a-49f9586bd734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8991df3-e720-47fa-86b5-cfe7c525dc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8991df3-e720-47fa-86b5-cfe7c525dc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1272981b-e72c-4b10-a061-74c532b3e897', 'volume_name': 'volume-1272981b-e72c-4b10-a061-74c532b3e897', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe613147-1d0e-478f-8390-e0f3205d026e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe613147-1d0e-478f-8390-e0f3205d026e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c185acd2-01e5-4b87-8896-ab20b327a2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:34 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Volume 1272981b-e72c-4b10-a061-74c532b3e897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1272981b-e72c-4b10-a061-74c532b3e897', 'volume_size': 1} Sep 10 18:35:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:44 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=17,cinder:INSERT=8,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:35:44 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:UPDATE=15,cinder:SELECT=21,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f16e1097-f277-46fe-b8da-ff89f33cc87b tempest-TestImageHashVerification-1387479123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.868s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f16e1097-f277-46fe-b8da-ff89f33cc87b tempest-TestImageHashVerification-1387479123 None] Uploaded volume to glance image-id: e4d6cf6a-ab8d-4d53-9b3a-80a3c2d9f22a. {{(pid=87842) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.348s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-489305126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0942bf67-52d3-4969-97ca-5d8b5e72f7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c1d06fdfaa44428b377a8e811b0f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:35:32Z,use_quota=True,user_id='c1eca5fa48fe46b6b6c0e5e21794dc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Creating volume 0942bf67-52d3-4969-97ca-5d8b5e72f7bc {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:35:51 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0942bf67-52d3-4969-97ca-5d8b5e72f7bc 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:51 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0942bf67-52d3-4969-97ca-5d8b5e72f7bc 1073741824 Sep 10 18:35:51 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:51 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f16e1097-f277-46fe-b8da-ff89f33cc87b tempest-TestImageHashVerification-1387479123 None] Copy volume to image completed successfully. Sep 10 18:35:51 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0942bf67-52d3-4969-97ca-5d8b5e72f7bc 1073741824" returned: 0 in 0.451s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0942bf67-52d3-4969-97ca-5d8b5e72f7bc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:51 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0942bf67-52d3-4969-97ca-5d8b5e72f7bc Sep 10 18:35:51 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:51 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0942bf67-52d3-4969-97ca-5d8b5e72f7bc" returned: 0 in 0.246s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.564s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-461165276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3752645-d889-47a9-9c4c-cc8f8f1710a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c1d06fdfaa44428b377a8e811b0f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:35:33Z,use_quota=True,user_id='c1eca5fa48fe46b6b6c0e5e21794dc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Creating volume f3752645-d889-47a9-9c4c-cc8f8f1710a2 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:35:51 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f3752645-d889-47a9-9c4c-cc8f8f1710a2 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2151302-b8ae-4723-adfd-d6468f565565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0942bf67-52d3-4969-97ca-5d8b5e72f7bc', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4dff7a7-899f-49dd-a9df-7a41246205f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:51 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f3752645-d889-47a9-9c4c-cc8f8f1710a2 1073741824 Sep 10 18:35:51 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] Acquiring lock "cinder-4baba96c-febf-412e-9588-5d4c0ff4f362-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:35:51 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Volume volume-0942bf67-52d3-4969-97ca-5d8b5e72f7bc (0942bf67-52d3-4969-97ca-5d8b5e72f7bc): created successfully Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4dff7a7-899f-49dd-a9df-7a41246205f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Flow 'volume_create_manager' (11d91642-4baf-4da6-9ed1-b042e0acd61d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] Lock "cinder-4baba96c-febf-412e-9588-5d4c0ff4f362-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:35:51 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-8e593971-18c2-4cc0-9b42-4988bfb57f34 tempest-CreateVolumesFromImageTest-1167842583 None] Created volume successfully. Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] Acquiring lock "cinder-quobyte-4baba96c-febf-412e-9588-5d4c0ff4f362" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] Lock "cinder-quobyte-4baba96c-febf-412e-9588-5d4c0ff4f362" acquired by "delete_volume" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[70971932-070f-42e9-8c20-39eac70b37c9]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:35:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:52 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362 Sep 10 18:35:52 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:52 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f3752645-d889-47a9-9c4c-cc8f8f1710a2 1073741824" returned: 0 in 0.419s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f3752645-d889-47a9-9c4c-cc8f8f1710a2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:52 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f3752645-d889-47a9-9c4c-cc8f8f1710a2 Sep 10 18:35:52 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:52 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362" returned: 0 in 0.367s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:52 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362 Sep 10 18:35:52 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:52 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f3752645-d889-47a9-9c4c-cc8f8f1710a2" returned: 0 in 0.259s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.675s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1858546656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639ed887-b639-496f-875d-3e824e3a5520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c1d06fdfaa44428b377a8e811b0f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:35:34Z,use_quota=True,user_id='c1eca5fa48fe46b6b6c0e5e21794dc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Creating volume 639ed887-b639-496f-875d-3e824e3a5520 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:35:52 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-639ed887-b639-496f-875d-3e824e3a5520 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:52 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-639ed887-b639-496f-875d-3e824e3a5520 1073741824 Sep 10 18:35:52 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0618232a-ce81-4f9e-b796-a06789d0755e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3752645-d889-47a9-9c4c-cc8f8f1710a2', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a66257-d5c6-498d-a7bf-922e941d3b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:52 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Volume volume-f3752645-d889-47a9-9c4c-cc8f8f1710a2 (f3752645-d889-47a9-9c4c-cc8f8f1710a2): created successfully Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a66257-d5c6-498d-a7bf-922e941d3b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Flow 'volume_create_manager' (c1bb0136-c5f0-4261-92d5-c9e0405f56f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:35:52 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4baba96c-febf-412e-9588-5d4c0ff4f362" returned: 0 in 0.282s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:52 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-6b8b501e-92f3-4998-91a7-a14954e70963 tempest-CreateVolumesFromImageTest-1167842583 None] Created volume successfully. Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] Lock "cinder-quobyte-4baba96c-febf-412e-9588-5d4c0ff4f362" released by "delete_volume" :: held 0.694s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] Created reservations ['6d3aea82-c1cb-40b3-bdfb-88084aa4578d', '5c5df336-c826-4071-a8df-fdb43b3ab5a7', 'fcd268b0-27ea-4468-873c-230509ee551c', '1a336c3a-fd73-400a-8a87-223e16b8e662'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:52 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:35:52 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:52 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-639ed887-b639-496f-875d-3e824e3a5520 1073741824" returned: 0 in 0.423s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-639ed887-b639-496f-875d-3e824e3a5520 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:53 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-639ed887-b639-496f-875d-3e824e3a5520 Sep 10 18:35:53 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:53 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.299s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:35:53 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] Deleted volume successfully. Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d232fb61-dee0-43af-bf27-31c9c46dd683 tempest-TestImageHashVerification-1387479123 None] Lock "cinder-4baba96c-febf-412e-9588-5d4c0ff4f362-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:35:53 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-639ed887-b639-496f-875d-3e824e3a5520" returned: 0 in 0.266s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.954s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-887599221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30448344-4713-4228-9a07-461caa96bb58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c1d06fdfaa44428b377a8e811b0f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:35:34Z,use_quota=True,user_id='c1eca5fa48fe46b6b6c0e5e21794dc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Creating volume 30448344-4713-4228-9a07-461caa96bb58 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:35:53 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-30448344-4713-4228-9a07-461caa96bb58 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bfa6a6-4493-4350-baab-04dc10515455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-639ed887-b639-496f-875d-3e824e3a5520', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:53 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-30448344-4713-4228-9a07-461caa96bb58 1073741824 Sep 10 18:35:53 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66aac899-4871-492c-85f9-a37c648d799d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:53 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Volume volume-639ed887-b639-496f-875d-3e824e3a5520 (639ed887-b639-496f-875d-3e824e3a5520): created successfully Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66aac899-4871-492c-85f9-a37c648d799d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Flow 'volume_create_manager' (797d4a21-6815-4e9e-9d5b-77b5e686088c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:35:53 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-5544765b-460f-469e-9172-9c67911ddeb2 tempest-CreateVolumesFromImageTest-1167842583 None] Created volume successfully. Sep 10 18:35:53 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-30448344-4713-4228-9a07-461caa96bb58 1073741824" returned: 0 in 0.504s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-30448344-4713-4228-9a07-461caa96bb58 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:53 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-30448344-4713-4228-9a07-461caa96bb58 Sep 10 18:35:53 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:54 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-30448344-4713-4228-9a07-461caa96bb58" returned: 0 in 0.258s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.594s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-622380363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1272981b-e72c-4b10-a061-74c532b3e897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c1d06fdfaa44428b377a8e811b0f2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:35:34Z,use_quota=True,user_id='c1eca5fa48fe46b6b6c0e5e21794dc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Creating volume 1272981b-e72c-4b10-a061-74c532b3e897 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:35:54 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1272981b-e72c-4b10-a061-74c532b3e897 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3711423d-7860-4701-8670-4ea3489f2ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30448344-4713-4228-9a07-461caa96bb58', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f443ba94-1048-4319-b79b-bc5223737ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:54 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1272981b-e72c-4b10-a061-74c532b3e897 1073741824 Sep 10 18:35:54 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:54 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Volume volume-30448344-4713-4228-9a07-461caa96bb58 (30448344-4713-4228-9a07-461caa96bb58): created successfully Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f443ba94-1048-4319-b79b-bc5223737ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Flow 'volume_create_manager' (be40cfb7-ba58-4cd0-804e-73b2ec1d3b48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:35:54 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e6c6a53b-147a-4a9d-aa66-878a5ba2f05d tempest-CreateVolumesFromImageTest-1167842583 None] Created volume successfully. Sep 10 18:35:54 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1272981b-e72c-4b10-a061-74c532b3e897 1073741824" returned: 0 in 0.482s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1272981b-e72c-4b10-a061-74c532b3e897 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:54 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1272981b-e72c-4b10-a061-74c532b3e897 Sep 10 18:35:54 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:54 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1272981b-e72c-4b10-a061-74c532b3e897" returned: 0 in 0.293s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c185acd2-01e5-4b87-8896-ab20b327a2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1272981b-e72c-4b10-a061-74c532b3e897', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d48cbf-268d-4ca2-8db3-9cd57fcfe952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:35:54 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Volume volume-1272981b-e72c-4b10-a061-74c532b3e897 (1272981b-e72c-4b10-a061-74c532b3e897): created successfully Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d48cbf-268d-4ca2-8db3-9cd57fcfe952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:35:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Flow 'volume_create_manager' (868abcfb-8a66-490b-be7e-7dc6126b66d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:35:54 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-718babb3-4465-4ca4-82d9-b657d48720e1 tempest-CreateVolumesFromImageTest-1167842583 None] Created volume successfully. Sep 10 18:35:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "cinder-1272981b-e72c-4b10-a061-74c532b3e897-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:35:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-1272981b-e72c-4b10-a061-74c532b3e897-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:35:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "cinder-quobyte-1272981b-e72c-4b10-a061-74c532b3e897" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:35:56 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-quobyte-1272981b-e72c-4b10-a061-74c532b3e897" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:35:56 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[590d71f8-ecf9-479e-9db9-438efcac27f5]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:35:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1272981b-e72c-4b10-a061-74c532b3e897 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:56 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1272981b-e72c-4b10-a061-74c532b3e897 Sep 10 18:35:56 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:56 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1272981b-e72c-4b10-a061-74c532b3e897" returned: 0 in 0.541s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1272981b-e72c-4b10-a061-74c532b3e897 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:56 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1272981b-e72c-4b10-a061-74c532b3e897 Sep 10 18:35:56 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:56 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1272981b-e72c-4b10-a061-74c532b3e897" returned: 0 in 0.335s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:56 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-quobyte-1272981b-e72c-4b10-a061-74c532b3e897" released by "delete_volume" :: held 0.930s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:35:57 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] Created reservations ['2127ba8c-e71f-4466-869b-fc49d04387b8', '668fc70b-a2e9-4779-8714-9aa18faa3e51', '7954fe35-5107-431a-8752-b3bddc8e03a1', 'e9dcf137-093c-41e6-882b-625d501a71b0'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:35:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:35:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:35:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:57 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:35:57 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:57 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.341s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:57 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:35:57 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] Deleted volume successfully. Sep 10 18:35:57 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5cee7d9d-2aae-40b9-8ca1-035a65d32a55 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-1272981b-e72c-4b10-a061-74c532b3e897-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:35:57 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-785df01d-6d75-448b-aa57-b548bc34a984 tempest-TestShelveInstance-2077717959 None] Terminate volume connection completed successfully. Sep 10 18:35:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-785df01d-6d75-448b-aa57-b548bc34a984 tempest-TestShelveInstance-2077717959 None] Deleting attachment 187b0dcb-dcba-46ae-99d0-c88b3c477427. {{(pid=87842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 10 18:35:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] Acquiring lock "cinder-7050f6f6-df04-4471-bb92-38e9414921e0-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:35:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] Lock "cinder-7050f6f6-df04-4471-bb92-38e9414921e0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:35:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] Acquiring lock "cinder-quobyte-7050f6f6-df04-4471-bb92-38e9414921e0" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:35:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] Lock "cinder-quobyte-7050f6f6-df04-4471-bb92-38e9414921e0" acquired by "delete_volume" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:35:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "cinder-30448344-4713-4228-9a07-461caa96bb58-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:35:58 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc3f2a5-5a7a-45d8-b666-c850f7a221e3]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:35:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7050f6f6-df04-4471-bb92-38e9414921e0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-30448344-4713-4228-9a07-461caa96bb58-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:35:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "cinder-quobyte-30448344-4713-4228-9a07-461caa96bb58" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:35:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-quobyte-30448344-4713-4228-9a07-461caa96bb58" acquired by "delete_volume" :: waited 0.031s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:35:58 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7050f6f6-df04-4471-bb92-38e9414921e0 Sep 10 18:35:58 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:58 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce39c59-058d-4ef7-a296-60ffef2e0558]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:35:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-30448344-4713-4228-9a07-461caa96bb58 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:58 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-30448344-4713-4228-9a07-461caa96bb58 Sep 10 18:35:58 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:58 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7050f6f6-df04-4471-bb92-38e9414921e0" returned: 0 in 0.464s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7050f6f6-df04-4471-bb92-38e9414921e0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:58 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7050f6f6-df04-4471-bb92-38e9414921e0 Sep 10 18:35:58 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:58 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-30448344-4713-4228-9a07-461caa96bb58" returned: 0 in 0.463s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-30448344-4713-4228-9a07-461caa96bb58 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:58 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-30448344-4713-4228-9a07-461caa96bb58 Sep 10 18:35:58 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:58 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7050f6f6-df04-4471-bb92-38e9414921e0" returned: 0 in 0.297s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] Lock "cinder-quobyte-7050f6f6-df04-4471-bb92-38e9414921e0" released by "delete_volume" :: held 0.818s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG cinder.quota [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] Created reservations ['8ff148e6-37b8-4983-968b-622651123de0', '47366edc-8939-46a5-a7ed-682770e3a6f3', '902d6554-ea13-4333-a6ce-63d0445081fb', 'cda271ac-9736-47e5-aa4e-2344e5855235'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:35:59 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-30448344-4713-4228-9a07-461caa96bb58" returned: 0 in 0.269s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-quobyte-30448344-4713-4228-9a07-461caa96bb58" released by "delete_volume" :: held 0.796s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:59 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:35:59 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] Created reservations ['2e75179c-8ba9-40bd-8d7e-04f66652172f', 'f1850f88-46bf-49ff-a726-4d3d898749c9', '4f0d784a-b146-44be-9436-cd3dbafe3d8a', '574df015-b664-4c05-b654-385203d069c2'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:59 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:35:59 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "cinder-639ed887-b639-496f-875d-3e824e3a5520-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-639ed887-b639-496f-875d-3e824e3a5520-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:35:59 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.414s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG cinder.manager [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "cinder-quobyte-639ed887-b639-496f-875d-3e824e3a5520" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:35:59 devstack cinder-volume[87842]: INFO cinder.volume.manager [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] Deleted volume successfully. Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-quobyte-639ed887-b639-496f-875d-3e824e3a5520" acquired by "delete_volume" :: waited 0.031s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [req-59e8ca30-34c1-4891-8722-4fcbf78352ca req-fc08382a-e844-4017-851c-ccf10790c9f2 tempest-TestShelveInstance-2077717959 None] Lock "cinder-7050f6f6-df04-4471-bb92-38e9414921e0-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[170f94b8-a55c-4912-b559-e2a4e7ffa365]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-639ed887-b639-496f-875d-3e824e3a5520 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:35:59 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.443s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:35:59 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] Deleted volume successfully. Sep 10 18:35:59 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-639ed887-b639-496f-875d-3e824e3a5520 Sep 10 18:35:59 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:35:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0852f9e1-d301-4127-95e1-df05b13011fe tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-30448344-4713-4228-9a07-461caa96bb58-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:00 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-639ed887-b639-496f-875d-3e824e3a5520" returned: 0 in 0.476s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-639ed887-b639-496f-875d-3e824e3a5520 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:00 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-639ed887-b639-496f-875d-3e824e3a5520 Sep 10 18:36:00 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:00 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-639ed887-b639-496f-875d-3e824e3a5520" returned: 0 in 0.293s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-quobyte-639ed887-b639-496f-875d-3e824e3a5520" released by "delete_volume" :: held 0.848s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:00 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] Created reservations ['9b53b112-005a-4db7-b7d1-7bcbf4b8ba17', 'f0766ad5-76ae-4bdb-95dd-3482519901ea', 'e53aa7ad-78ae-4253-a92b-65a3447ffd66', 'ac47cf28-9d6b-41fa-b6e5-a146a97012d3'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:36:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:00 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:00 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:00 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:36:00 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "cinder-f3752645-d889-47a9-9c4c-cc8f8f1710a2-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-f3752645-d889-47a9-9c4c-cc8f8f1710a2-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "cinder-quobyte-f3752645-d889-47a9-9c4c-cc8f8f1710a2" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-quobyte-f3752645-d889-47a9-9c4c-cc8f8f1710a2" acquired by "delete_volume" :: waited 0.020s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:00 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[272f2e7e-793c-48c2-aac4-2393fdf87866]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f3752645-d889-47a9-9c4c-cc8f8f1710a2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:01 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.411s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:01 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:36:01 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] Deleted volume successfully. Sep 10 18:36:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5c2c1bad-241e-457d-abd9-ef00593e1405 tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-639ed887-b639-496f-875d-3e824e3a5520-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:01 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f3752645-d889-47a9-9c4c-cc8f8f1710a2 Sep 10 18:36:01 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:01 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f3752645-d889-47a9-9c4c-cc8f8f1710a2" returned: 0 in 0.396s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f3752645-d889-47a9-9c4c-cc8f8f1710a2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:01 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f3752645-d889-47a9-9c4c-cc8f8f1710a2 Sep 10 18:36:01 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:01 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f3752645-d889-47a9-9c4c-cc8f8f1710a2" returned: 0 in 0.280s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-quobyte-f3752645-d889-47a9-9c4c-cc8f8f1710a2" released by "delete_volume" :: held 0.719s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:01 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] Created reservations ['d815e586-2c36-4f93-a657-e3b0409920f3', '97aee73f-f6c3-4c7f-9ef8-b16b8bf00c97', '93435a94-ebbc-462f-abc6-e094719d2e9e', '83e05235-f145-4bd3-add8-2001540fe835'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:36:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:01 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:36:01 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "cinder-0942bf67-52d3-4969-97ca-5d8b5e72f7bc-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-0942bf67-52d3-4969-97ca-5d8b5e72f7bc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:02 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.367s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:02 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:36:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "cinder-quobyte-0942bf67-52d3-4969-97ca-5d8b5e72f7bc" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:02 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] Deleted volume successfully. Sep 10 18:36:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-quobyte-0942bf67-52d3-4969-97ca-5d8b5e72f7bc" acquired by "delete_volume" :: waited 0.020s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d2467843-13e0-4f29-a113-20758017265f tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-f3752645-d889-47a9-9c4c-cc8f8f1710a2-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:02 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8165fa10-a443-4bc1-bd55-41de2889240a]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0942bf67-52d3-4969-97ca-5d8b5e72f7bc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:02 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0942bf67-52d3-4969-97ca-5d8b5e72f7bc Sep 10 18:36:02 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:02 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0942bf67-52d3-4969-97ca-5d8b5e72f7bc" returned: 0 in 0.421s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0942bf67-52d3-4969-97ca-5d8b5e72f7bc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:02 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0942bf67-52d3-4969-97ca-5d8b5e72f7bc Sep 10 18:36:02 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:02 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0942bf67-52d3-4969-97ca-5d8b5e72f7bc" returned: 0 in 0.336s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-quobyte-0942bf67-52d3-4969-97ca-5d8b5e72f7bc" released by "delete_volume" :: held 0.820s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:03 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] Created reservations ['999a1ffa-ce32-443f-916e-4918c35e3482', 'f2e3b3ff-d37c-4b9d-9fb9-20f9682a2c3a', '67aceede-6385-4663-9256-c488c38a6cc7', 'f5bd76ad-fc2c-4607-ad38-24d8f8f67a84'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:36:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:03 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:36:03 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:03 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.271s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:03 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:36:03 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] Deleted volume successfully. Sep 10 18:36:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0cf39207-753b-455b-81eb-acd333f4986f tempest-CreateVolumesFromImageTest-1167842583 None] Lock "cinder-0942bf67-52d3-4969-97ca-5d8b5e72f7bc-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Flow 'volume_create_manager' (fbb25472-4296-4bf3-89fe-d9aaab632ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fd0932-0440-41f7-94a8-08f0f77c0aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fd0932-0440-41f7-94a8-08f0f77c0aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-215195797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f63c4cd6-010b-48c5-8dad-8b1ae254d32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaf8320f3ff4d66b1345a72674903fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:07Z,use_quota=True,user_id='f18c80db25024bc88583645a05969b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ecdaf0-4aaa-484f-a555-c1926b212d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ecdaf0-4aaa-484f-a555-c1926b212d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55583931-8233-4cb9-92db-6d1c9c9ceccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55583931-8233-4cb9-92db-6d1c9c9ceccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f63c4cd6-010b-48c5-8dad-8b1ae254d32d', 'volume_name': 'volume-f63c4cd6-010b-48c5-8dad-8b1ae254d32d', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54724ff8-7d49-4d51-814c-e48b94eeb197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54724ff8-7d49-4d51-814c-e48b94eeb197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8530fb-afa6-4223-acb1-fdee73b0a350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:07 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Volume f63c4cd6-010b-48c5-8dad-8b1ae254d32d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f63c4cd6-010b-48c5-8dad-8b1ae254d32d', 'volume_size': 1} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-215195797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f63c4cd6-010b-48c5-8dad-8b1ae254d32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaf8320f3ff4d66b1345a72674903fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:07Z,use_quota=True,user_id='f18c80db25024bc88583645a05969b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Creating volume f63c4cd6-010b-48c5-8dad-8b1ae254d32d {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:36:07 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f63c4cd6-010b-48c5-8dad-8b1ae254d32d 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:07 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f63c4cd6-010b-48c5-8dad-8b1ae254d32d 1073741824 Sep 10 18:36:07 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Flow 'volume_create_manager' (de8407a2-ed2d-4b4f-9b3a-3561671b63ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09408092-e741-400d-8e59-edc01e601713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09408092-e741-400d-8e59-edc01e601713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-254804827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0caf985c-c97e-46d4-ae71-15485541e9f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8ce7ec4e504f9c93178eb411be9c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:07Z,use_quota=True,user_id='6b73a94dec89412e94cb0901c1fab693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbcd4e1-04fa-4184-994d-850ef6447a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbcd4e1-04fa-4184-994d-850ef6447a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f58eb6-1d13-4eae-b315-227ed6a9ad0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f58eb6-1d13-4eae-b315-227ed6a9ad0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0caf985c-c97e-46d4-ae71-15485541e9f5', 'volume_name': 'volume-0caf985c-c97e-46d4-ae71-15485541e9f5', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a11386a5-35ef-4ae6-938b-6c5fb34eca49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a11386a5-35ef-4ae6-938b-6c5fb34eca49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca64094d-ace5-4c09-a60b-f670f8b3135e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:07 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Volume 0caf985c-c97e-46d4-ae71-15485541e9f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0caf985c-c97e-46d4-ae71-15485541e9f5', 'volume_size': 1} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:07 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f63c4cd6-010b-48c5-8dad-8b1ae254d32d 1073741824" returned: 0 in 0.447s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f63c4cd6-010b-48c5-8dad-8b1ae254d32d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:07 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f63c4cd6-010b-48c5-8dad-8b1ae254d32d Sep 10 18:36:07 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:08 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f63c4cd6-010b-48c5-8dad-8b1ae254d32d" returned: 0 in 0.281s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.632s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-254804827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0caf985c-c97e-46d4-ae71-15485541e9f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8ce7ec4e504f9c93178eb411be9c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:07Z,use_quota=True,user_id='6b73a94dec89412e94cb0901c1fab693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Creating volume 0caf985c-c97e-46d4-ae71-15485541e9f5 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:36:08 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8530fb-afa6-4223-acb1-fdee73b0a350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f63c4cd6-010b-48c5-8dad-8b1ae254d32d', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c46f238b-86a5-4400-81da-2b0afa263355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:08 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5 1073741824 Sep 10 18:36:08 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:08 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Volume volume-f63c4cd6-010b-48c5-8dad-8b1ae254d32d (f63c4cd6-010b-48c5-8dad-8b1ae254d32d): created successfully Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c46f238b-86a5-4400-81da-2b0afa263355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Flow 'volume_create_manager' (fbb25472-4296-4bf3-89fe-d9aaab632ace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:08 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-11cfe56d-974f-458c-b7ba-c4326b533a42 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Created volume successfully. Sep 10 18:36:08 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5 1073741824" returned: 0 in 0.433s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:08 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5 Sep 10 18:36:08 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:08 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5" returned: 0 in 0.260s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca64094d-ace5-4c09-a60b-f670f8b3135e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0caf985c-c97e-46d4-ae71-15485541e9f5', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bda343-854a-4586-a1af-868a696cf95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:08 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Volume volume-0caf985c-c97e-46d4-ae71-15485541e9f5 (0caf985c-c97e-46d4-ae71-15485541e9f5): created successfully Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bda343-854a-4586-a1af-868a696cf95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Flow 'volume_create_manager' (de8407a2-ed2d-4b4f-9b3a-3561671b63ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:08 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ed11978c-7409-4839-9e87-db9fa12aa8d1 tempest-CreateVolumesFromSnapshotTest-710952592 None] Created volume successfully. Sep 10 18:36:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c3545281-a290-44bb-b203-d40feb171999 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c3545281-a290-44bb-b203-d40feb171999 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c3545281-a290-44bb-b203-d40feb171999 tempest-CreateVolumesFromSnapshotTest-710952592 None] Creating offline snapshot 8d3256ff-74a7-441b-b26f-fbff96d2d04b of volume 0caf985c-c97e-46d4-ae71-15485541e9f5 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:36:09 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6287cd6d-24ad-48ae-a6f8-9d01e751c307]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c3545281-a290-44bb-b203-d40feb171999 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:09 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5 Sep 10 18:36:09 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:09 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:36:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Flow 'volume_create_manager' (fba83488-2690-473a-9a30-7e2ecc6ccb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc43e0e-d5d3-4253-a679-2ea126f590ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc43e0e-d5d3-4253-a679-2ea126f590ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-759629946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ab9d29-384b-42ca-851c-414b7074bbb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaf8320f3ff4d66b1345a72674903fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:10Z,use_quota=True,user_id='f18c80db25024bc88583645a05969b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6237110e-929f-4fe0-8b7e-5813a24bcd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6237110e-929f-4fe0-8b7e-5813a24bcd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666176e0-a6f7-446b-8031-c1ceae824833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666176e0-a6f7-446b-8031-c1ceae824833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23ab9d29-384b-42ca-851c-414b7074bbb1', 'volume_name': 'volume-23ab9d29-384b-42ca-851c-414b7074bbb1', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34eeb8b-31a3-4e67-bbd6-6d150af1fae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34eeb8b-31a3-4e67-bbd6-6d150af1fae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a76e46a-6318-479a-821c-9269fef326ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:09 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Volume 23ab9d29-384b-42ca-851c-414b7074bbb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23ab9d29-384b-42ca-851c-414b7074bbb1', 'volume_size': 1} Sep 10 18:36:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:10 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c3545281-a290-44bb-b203-d40feb171999 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5" returned: 0 in 0.493s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c3545281-a290-44bb-b203-d40feb171999 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:10 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b 1G Sep 10 18:36:10 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Flow 'volume_create_manager' (c382e672-efa4-4bf5-acff-8f940f1fc646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d94669-5948-49cf-9764-93ab7a0a338d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d94669-5948-49cf-9764-93ab7a0a338d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1984147373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f561a1-b5b8-495e-be91-0c9d7909fcff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaf8320f3ff4d66b1345a72674903fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:10Z,use_quota=True,user_id='f18c80db25024bc88583645a05969b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282e0bfb-d016-450d-9549-3acaeaf6449f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282e0bfb-d016-450d-9549-3acaeaf6449f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1de24b-1a59-4f54-9251-18cf0c0c1820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1de24b-1a59-4f54-9251-18cf0c0c1820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3f561a1-b5b8-495e-be91-0c9d7909fcff', 'volume_name': 'volume-c3f561a1-b5b8-495e-be91-0c9d7909fcff', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e35fe61-9c4d-49fd-933f-5bc8c243b11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e35fe61-9c4d-49fd-933f-5bc8c243b11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e79c68-5ed1-4827-948f-107e31b0b58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:10 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Volume c3f561a1-b5b8-495e-be91-0c9d7909fcff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3f561a1-b5b8-495e-be91-0c9d7909fcff', 'volume_size': 1} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:10 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c3545281-a290-44bb-b203-d40feb171999 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b 1G" returned: 0 in 0.539s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c3545281-a290-44bb-b203-d40feb171999 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0caf985c-c97e-46d4-ae71-15485541e9f5 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:10 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0caf985c-c97e-46d4-ae71-15485541e9f5 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b Sep 10 18:36:10 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Flow 'volume_create_manager' (1fd22d47-36b7-48e0-b51f-c8abca02dfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5672438-9a33-44d8-8891-83defa58d64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5672438-9a33-44d8-8891-83defa58d64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-14813848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaf8320f3ff4d66b1345a72674903fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:11Z,use_quota=True,user_id='f18c80db25024bc88583645a05969b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad55966c-974a-41c7-a820-2631f570b28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad55966c-974a-41c7-a820-2631f570b28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805bdac3-bc22-4ec4-8a28-2f4cacbe6be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805bdac3-bc22-4ec4-8a28-2f4cacbe6be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609', 'volume_name': 'volume-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417c4914-3c2a-4a3a-b1d3-0bd3b27a2380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417c4914-3c2a-4a3a-b1d3-0bd3b27a2380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af55c28-20f9-4472-a2e5-2cbc823150de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:10 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Volume 8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609', 'volume_size': 1} Sep 10 18:36:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:11 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c3545281-a290-44bb-b203-d40feb171999 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0caf985c-c97e-46d4-ae71-15485541e9f5 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b" returned: 0 in 0.365s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:11 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-c3545281-a290-44bb-b203-d40feb171999 tempest-CreateVolumesFromSnapshotTest-710952592 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b is being set with open permissions: ugo+rw Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c3545281-a290-44bb-b203-d40feb171999 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:11 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b Sep 10 18:36:11 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Flow 'volume_create_manager' (50d738be-7e7e-428c-abdd-26610e4681f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a83d3b02-0f6f-4958-ab86-94430d6d978d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a83d3b02-0f6f-4958-ab86-94430d6d978d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-874751693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa112ab-172d-4a5a-8108-1579850e017c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaf8320f3ff4d66b1345a72674903fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:11Z,use_quota=True,user_id='f18c80db25024bc88583645a05969b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec04bb87-3e77-4666-81d2-3a4a511031d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec04bb87-3e77-4666-81d2-3a4a511031d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9db1ea-4f8b-4adf-b926-226aa256d840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9db1ea-4f8b-4adf-b926-226aa256d840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fa112ab-172d-4a5a-8108-1579850e017c', 'volume_name': 'volume-9fa112ab-172d-4a5a-8108-1579850e017c', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023edb19-55ab-4eec-8ff5-829e0acce9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023edb19-55ab-4eec-8ff5-829e0acce9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5817e5ad-c3b1-44bb-9fc3-b46a5d423d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:11 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Volume 9fa112ab-172d-4a5a-8108-1579850e017c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fa112ab-172d-4a5a-8108-1579850e017c', 'volume_size': 1} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:11 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c3545281-a290-44bb-b203-d40feb171999 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b" returned: 0 in 0.340s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c3545281-a290-44bb-b203-d40feb171999 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:11 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.info Sep 10 18:36:11 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Flow 'volume_create_manager' (e6b4763f-55f3-44e0-aa41-64427f74f29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59eb59d4-d64f-461f-911e-37786f80b460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59eb59d4-d64f-461f-911e-37786f80b460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1621395121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaf8320f3ff4d66b1345a72674903fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:12Z,use_quota=True,user_id='f18c80db25024bc88583645a05969b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c15234-e3cd-47d6-998f-e7a4f702e710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c15234-e3cd-47d6-998f-e7a4f702e710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2be89b6-6b61-4dd2-906e-4e255f479a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2be89b6-6b61-4dd2-906e-4e255f479a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50', 'volume_name': 'volume-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a707243-6de0-4b09-ba0b-5bc3118b13ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a707243-6de0-4b09-ba0b-5bc3118b13ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f4f9ce-fa2d-4005-adb2-b604bd03c92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:11 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Volume 75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50', 'volume_size': 1} Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:11 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c3545281-a290-44bb-b203-d40feb171999 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.info" returned: 0 in 0.303s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:11 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-c3545281-a290-44bb-b203-d40feb171999 tempest-CreateVolumesFromSnapshotTest-710952592 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.info is being set with open permissions: ugo+rw Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c3545281-a290-44bb-b203-d40feb171999 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:11 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.info Sep 10 18:36:11 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:11 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c3545281-a290-44bb-b203-d40feb171999 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.info" returned: 0 in 0.251s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c3545281-a290-44bb-b203-d40feb171999 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.397s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.026s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-759629946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ab9d29-384b-42ca-851c-414b7074bbb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaf8320f3ff4d66b1345a72674903fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:10Z,use_quota=True,user_id='f18c80db25024bc88583645a05969b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Creating volume 23ab9d29-384b-42ca-851c-414b7074bbb1 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:36:12 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23ab9d29-384b-42ca-851c-414b7074bbb1 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:12 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23ab9d29-384b-42ca-851c-414b7074bbb1 1073741824 Sep 10 18:36:12 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:12 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c3545281-a290-44bb-b203-d40feb171999 tempest-CreateVolumesFromSnapshotTest-710952592 None] Create snapshot completed successfully Sep 10 18:36:12 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23ab9d29-384b-42ca-851c-414b7074bbb1 1073741824" returned: 0 in 0.489s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23ab9d29-384b-42ca-851c-414b7074bbb1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:12 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23ab9d29-384b-42ca-851c-414b7074bbb1 Sep 10 18:36:12 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:12 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23ab9d29-384b-42ca-851c-414b7074bbb1" returned: 0 in 0.250s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.332s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1984147373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f561a1-b5b8-495e-be91-0c9d7909fcff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaf8320f3ff4d66b1345a72674903fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:10Z,use_quota=True,user_id='f18c80db25024bc88583645a05969b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Creating volume c3f561a1-b5b8-495e-be91-0c9d7909fcff {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:36:12 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3f561a1-b5b8-495e-be91-0c9d7909fcff 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a76e46a-6318-479a-821c-9269fef326ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23ab9d29-384b-42ca-851c-414b7074bbb1', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767cf2e7-330b-4d29-bda3-79e7ec6e93c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:12 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3f561a1-b5b8-495e-be91-0c9d7909fcff 1073741824 Sep 10 18:36:12 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:12 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Volume volume-23ab9d29-384b-42ca-851c-414b7074bbb1 (23ab9d29-384b-42ca-851c-414b7074bbb1): created successfully Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767cf2e7-330b-4d29-bda3-79e7ec6e93c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Flow 'volume_create_manager' (fba83488-2690-473a-9a30-7e2ecc6ccb52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:12 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f687e27f-e446-454d-b280-fa4a454073a6 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Created volume successfully. Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Flow 'volume_create_manager' (fd20a7d9-b1af-4a67-ad12-41ddc6f03d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcaa0fc3-6c5b-4db1-86ca-5fa0ae1fffa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcaa0fc3-6c5b-4db1-86ca-5fa0ae1fffa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-793099181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b3bc95-b77d-4686-a3ad-21c2f4b3d633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8ce7ec4e504f9c93178eb411be9c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:13Z,use_quota=True,user_id='6b73a94dec89412e94cb0901c1fab693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40dd2c27-225c-44ba-90a7-e8c05da54236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40dd2c27-225c-44ba-90a7-e8c05da54236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9a2119-17b1-42ff-bada-85e4dd332da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9a2119-17b1-42ff-bada-85e4dd332da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7b3bc95-b77d-4686-a3ad-21c2f4b3d633', 'volume_name': 'volume-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:13 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a2916f-861f-4a92-b6b9-7cc38c95bd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a2916f-861f-4a92-b6b9-7cc38c95bd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aaff1b5-88f0-4e17-88b8-3fd77308b7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:13 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Volume a7b3bc95-b77d-4686-a3ad-21c2f4b3d633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633', 'volume_size': 1} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3f561a1-b5b8-495e-be91-0c9d7909fcff 1073741824" returned: 0 in 0.641s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3f561a1-b5b8-495e-be91-0c9d7909fcff {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:13 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3f561a1-b5b8-495e-be91-0c9d7909fcff Sep 10 18:36:13 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Flow 'volume_create_manager' (ed56a5c3-c402-40f2-a1d3-2538cdeee673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:13 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5f4197-8c8c-4bc2-9b1b-a1a8bb15d1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3f561a1-b5b8-495e-be91-0c9d7909fcff" returned: 0 in 0.374s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-14813848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaf8320f3ff4d66b1345a72674903fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:11Z,use_quota=True,user_id='f18c80db25024bc88583645a05969b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Creating volume 8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:36:13 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5f4197-8c8c-4bc2-9b1b-a1a8bb15d1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1565260243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278f98d5-6179-4efe-9bd5-c49351b81fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8ce7ec4e504f9c93178eb411be9c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:14Z,use_quota=True,user_id='6b73a94dec89412e94cb0901c1fab693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f75fde4-9855-4e00-b1eb-a794f4577388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:13 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609 1073741824 Sep 10 18:36:13 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f75fde4-9855-4e00-b1eb-a794f4577388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04da634-f04c-4714-92d8-090e8b666bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04da634-f04c-4714-92d8-090e8b666bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '278f98d5-6179-4efe-9bd5-c49351b81fe9', 'volume_name': 'volume-278f98d5-6179-4efe-9bd5-c49351b81fe9', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63111fa0-5e34-449e-bec5-6d9841b3892a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63111fa0-5e34-449e-bec5-6d9841b3892a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57600e7c-ddb2-401e-8547-64a21ae46724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:13 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Volume 278f98d5-6179-4efe-9bd5-c49351b81fe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-278f98d5-6179-4efe-9bd5-c49351b81fe9', 'volume_size': 1} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e79c68-5ed1-4827-948f-107e31b0b58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f561a1-b5b8-495e-be91-0c9d7909fcff', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7b6a84-d7ea-44b9-8dfd-1e9f00f15c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:13 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Volume volume-c3f561a1-b5b8-495e-be91-0c9d7909fcff (c3f561a1-b5b8-495e-be91-0c9d7909fcff): created successfully Sep 10 18:36:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7b6a84-d7ea-44b9-8dfd-1e9f00f15c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Flow 'volume_create_manager' (c382e672-efa4-4bf5-acff-8f940f1fc646) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:14 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ff91a9b9-5674-4dde-b746-edf28dacaf43 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Created volume successfully. Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Flow 'volume_create_manager' (de396623-cef2-4e18-8730-0e88e8926111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d82f3a-35d6-4ceb-9c7d-fdcdc948d5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d82f3a-35d6-4ceb-9c7d-fdcdc948d5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-969587675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f24ea33-578e-4131-af75-0fd2c3543064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8ce7ec4e504f9c93178eb411be9c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:14Z,use_quota=True,user_id='6b73a94dec89412e94cb0901c1fab693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00a8a08-917f-4482-86c9-346410228751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00a8a08-917f-4482-86c9-346410228751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f677d9c9-fe1b-4461-b401-8e31e5417ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f677d9c9-fe1b-4461-b401-8e31e5417ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f24ea33-578e-4131-af75-0fd2c3543064', 'volume_name': 'volume-0f24ea33-578e-4131-af75-0fd2c3543064', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e63f90-f489-4081-9e51-e302c4f56e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e63f90-f489-4081-9e51-e302c4f56e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fe0a7a-2f4b-4868-bd53-b7c7930e5c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:14 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Volume 0f24ea33-578e-4131-af75-0fd2c3543064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f24ea33-578e-4131-af75-0fd2c3543064', 'volume_size': 1} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:14 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609 1073741824" returned: 0 in 0.611s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:14 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609 Sep 10 18:36:14 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Flow 'volume_create_manager' (a414ffcd-8308-4d9d-97e0-a827431c0e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e308e5-bfdd-4a31-99c9-e6a0e2d40f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e308e5-bfdd-4a31-99c9-e6a0e2d40f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1276739679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9d3be4-3d5f-4536-b7e9-8320021eb4d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8ce7ec4e504f9c93178eb411be9c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:15Z,use_quota=True,user_id='6b73a94dec89412e94cb0901c1fab693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1bcd2f6-d17d-41c5-bb8c-0b95b26735e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1bcd2f6-d17d-41c5-bb8c-0b95b26735e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a4f098-2215-46b4-8df9-a7f8355286b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a4f098-2215-46b4-8df9-a7f8355286b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e9d3be4-3d5f-4536-b7e9-8320021eb4d6', 'volume_name': 'volume-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5a8407-b1f8-4a49-8f63-c16074c89879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5a8407-b1f8-4a49-8f63-c16074c89879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c425925c-a1a3-4fc6-bc76-80a05f5de7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:14 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Volume 6e9d3be4-3d5f-4536-b7e9-8320021eb4d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6', 'volume_size': 1} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:14 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609" returned: 0 in 0.310s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.592s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-874751693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa112ab-172d-4a5a-8108-1579850e017c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaf8320f3ff4d66b1345a72674903fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:11Z,use_quota=True,user_id='f18c80db25024bc88583645a05969b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Creating volume 9fa112ab-172d-4a5a-8108-1579850e017c {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:36:14 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9fa112ab-172d-4a5a-8108-1579850e017c 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af55c28-20f9-4472-a2e5-2cbc823150de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:14 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9fa112ab-172d-4a5a-8108-1579850e017c 1073741824 Sep 10 18:36:14 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f29549-2403-4aeb-96ed-f4857843def3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:14 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Volume volume-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609 (8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609): created successfully Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f29549-2403-4aeb-96ed-f4857843def3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Flow 'volume_create_manager' (1fd22d47-36b7-48e0-b51f-c8abca02dfb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:15 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-985947c8-fe77-4f08-9af0-9a4aa716515d tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Created volume successfully. Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Flow 'volume_create_manager' (79e6aa56-6d11-496c-9bee-49caafcc3c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28135cc6-3118-4f40-9e8c-a1741bf02b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28135cc6-3118-4f40-9e8c-a1741bf02b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1550928480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08788f91-f905-4d39-8136-66dfdc13af01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8ce7ec4e504f9c93178eb411be9c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:15Z,use_quota=True,user_id='6b73a94dec89412e94cb0901c1fab693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7545be35-d05a-4b07-87cf-43593c031419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7545be35-d05a-4b07-87cf-43593c031419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d1f394-5d65-498d-b10e-af615808f424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d1f394-5d65-498d-b10e-af615808f424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08788f91-f905-4d39-8136-66dfdc13af01', 'volume_name': 'volume-08788f91-f905-4d39-8136-66dfdc13af01', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35919512-a8d2-4b87-aa5c-c10b4df946be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35919512-a8d2-4b87-aa5c-c10b4df946be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ab2492-75c6-4c6c-8290-5c3e2e413669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:15 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Volume 08788f91-f905-4d39-8136-66dfdc13af01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08788f91-f905-4d39-8136-66dfdc13af01', 'volume_size': 1} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:15 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9fa112ab-172d-4a5a-8108-1579850e017c 1073741824" returned: 0 in 0.575s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9fa112ab-172d-4a5a-8108-1579850e017c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:15 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9fa112ab-172d-4a5a-8108-1579850e017c Sep 10 18:36:15 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:15 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9fa112ab-172d-4a5a-8108-1579850e017c" returned: 0 in 0.262s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.031s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1621395121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaf8320f3ff4d66b1345a72674903fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:12Z,use_quota=True,user_id='f18c80db25024bc88583645a05969b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Creating volume 75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:36:15 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:15 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50 1073741824 Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5817e5ad-c3b1-44bb-9fc3-b46a5d423d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fa112ab-172d-4a5a-8108-1579850e017c', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:15 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3fa67b-8f1f-4a03-a952-6a4d7b25d2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:15 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Volume volume-9fa112ab-172d-4a5a-8108-1579850e017c (9fa112ab-172d-4a5a-8108-1579850e017c): created successfully Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3fa67b-8f1f-4a03-a952-6a4d7b25d2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Flow 'volume_create_manager' (50d738be-7e7e-428c-abdd-26610e4681f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:15 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-03996779-e4e6-4cb2-a70e-a587c54cefef tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Created volume successfully. Sep 10 18:36:16 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50 1073741824" returned: 0 in 0.505s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:16 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50 Sep 10 18:36:16 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:16 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50" returned: 0 in 0.252s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:36:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.110s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-793099181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b3bc95-b77d-4686-a3ad-21c2f4b3d633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8ce7ec4e504f9c93178eb411be9c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:13Z,use_quota=True,user_id='6b73a94dec89412e94cb0901c1fab693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:36:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Creating volume a7b3bc95-b77d-4686-a3ad-21c2f4b3d633 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:36:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:36:16 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:36:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:16 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633 1073741824 Sep 10 18:36:16 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f4f9ce-fa2d-4005-adb2-b604bd03c92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da55df4d-e40a-49b1-9b06-24d2636f43e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:16 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Volume volume-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50 (75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50): created successfully Sep 10 18:36:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da55df4d-e40a-49b1-9b06-24d2636f43e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:16 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Flow 'volume_create_manager' (e6b4763f-55f3-44e0-aa41-64427f74f29c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:16 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-47d9d270-9246-46b4-aaf0-6f05cef9759b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Created volume successfully. Sep 10 18:36:17 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633 1073741824" returned: 0 in 0.454s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:17 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633 Sep 10 18:36:17 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "cinder-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:17 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633" returned: 0 in 0.295s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.417s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1565260243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278f98d5-6179-4efe-9bd5-c49351b81fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8ce7ec4e504f9c93178eb411be9c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:14Z,use_quota=True,user_id='6b73a94dec89412e94cb0901c1fab693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Creating volume 278f98d5-6179-4efe-9bd5-c49351b81fe9 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:36:17 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-278f98d5-6179-4efe-9bd5-c49351b81fe9 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aaff1b5-88f0-4e17-88b8-3fd77308b7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:17 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-278f98d5-6179-4efe-9bd5-c49351b81fe9 1073741824 Sep 10 18:36:17 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e856cde6-63fd-4981-a32f-d80b1b659a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:17 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Volume volume-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633 (a7b3bc95-b77d-4686-a3ad-21c2f4b3d633): created successfully Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e856cde6-63fd-4981-a32f-d80b1b659a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Flow 'volume_create_manager' (fd20a7d9-b1af-4a67-ad12-41ddc6f03d39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "cinder-quobyte-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:17 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-afcff7c0-4a88-481a-bfca-5499e01de2f9 tempest-CreateVolumesFromSnapshotTest-710952592 None] Created volume successfully. Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-quobyte-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50" acquired by "delete_volume" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[92521ac7-beb2-4bff-a800-d6c98ac4c7c9]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:17 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50 Sep 10 18:36:17 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:17 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-278f98d5-6179-4efe-9bd5-c49351b81fe9 1073741824" returned: 0 in 0.539s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-278f98d5-6179-4efe-9bd5-c49351b81fe9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:17 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50" returned: 0 in 0.432s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:18 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-278f98d5-6179-4efe-9bd5-c49351b81fe9 Sep 10 18:36:18 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:18 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50 Sep 10 18:36:18 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:18 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-278f98d5-6179-4efe-9bd5-c49351b81fe9" returned: 0 in 0.284s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.949s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-969587675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f24ea33-578e-4131-af75-0fd2c3543064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8ce7ec4e504f9c93178eb411be9c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:14Z,use_quota=True,user_id='6b73a94dec89412e94cb0901c1fab693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Creating volume 0f24ea33-578e-4131-af75-0fd2c3543064 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:36:18 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0f24ea33-578e-4131-af75-0fd2c3543064 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:18 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50" returned: 0 in 0.297s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:18 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0f24ea33-578e-4131-af75-0fd2c3543064 1073741824 Sep 10 18:36:18 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57600e7c-ddb2-401e-8547-64a21ae46724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-278f98d5-6179-4efe-9bd5-c49351b81fe9', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1a9eb5-2a55-4f47-8a7d-682ba4f6c4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-quobyte-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50" released by "delete_volume" :: held 0.802s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:18 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Volume volume-278f98d5-6179-4efe-9bd5-c49351b81fe9 (278f98d5-6179-4efe-9bd5-c49351b81fe9): created successfully Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1a9eb5-2a55-4f47-8a7d-682ba4f6c4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Flow 'volume_create_manager' (ed56a5c3-c402-40f2-a1d3-2538cdeee673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:18 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-6b545b55-be9e-46f5-853b-e319b6eb2ec4 tempest-CreateVolumesFromSnapshotTest-710952592 None] Created volume successfully. Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Created reservations ['09ce3eb2-aa44-4e89-814e-e034d2c1be75', '1b172ab8-7219-4254-9f33-1327d3a9f8f8', '26dd36c6-4209-4d8e-a949-9fbfa2315c67', '956c3e27-bdd7-4f9d-8e5c-ec4a07508cba'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:18 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:36:18 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "cinder-9fa112ab-172d-4a5a-8108-1579850e017c-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-9fa112ab-172d-4a5a-8108-1579850e017c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "cinder-quobyte-9fa112ab-172d-4a5a-8108-1579850e017c" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-quobyte-9fa112ab-172d-4a5a-8108-1579850e017c" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[05944461-8d4d-4fef-8817-448734a1bfcb]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9fa112ab-172d-4a5a-8108-1579850e017c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:18 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.268s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:36:18 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Deleted volume successfully. Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9b48767d-6206-4bdc-af74-a36bdf228617 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-75d8ea45-dc3a-482d-ae7a-5d1a9ad2df50-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:18 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0f24ea33-578e-4131-af75-0fd2c3543064 1073741824" returned: 0 in 0.502s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:18 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9fa112ab-172d-4a5a-8108-1579850e017c Sep 10 18:36:18 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0f24ea33-578e-4131-af75-0fd2c3543064 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:18 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0f24ea33-578e-4131-af75-0fd2c3543064 Sep 10 18:36:18 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:19 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9fa112ab-172d-4a5a-8108-1579850e017c" returned: 0 in 0.362s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9fa112ab-172d-4a5a-8108-1579850e017c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:19 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0f24ea33-578e-4131-af75-0fd2c3543064" returned: 0 in 0.249s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.326s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1276739679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9d3be4-3d5f-4536-b7e9-8320021eb4d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8ce7ec4e504f9c93178eb411be9c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:15Z,use_quota=True,user_id='6b73a94dec89412e94cb0901c1fab693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Creating volume 6e9d3be4-3d5f-4536-b7e9-8320021eb4d6 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:19 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9fa112ab-172d-4a5a-8108-1579850e017c Sep 10 18:36:19 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:36:19 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fe0a7a-2f4b-4868-bd53-b7c7930e5c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f24ea33-578e-4131-af75-0fd2c3543064', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:19 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6 1073741824 Sep 10 18:36:19 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5baa1066-a71e-437b-b30a-3bbc31d28573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:19 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Volume volume-0f24ea33-578e-4131-af75-0fd2c3543064 (0f24ea33-578e-4131-af75-0fd2c3543064): created successfully Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5baa1066-a71e-437b-b30a-3bbc31d28573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Flow 'volume_create_manager' (de396623-cef2-4e18-8730-0e88e8926111) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:19 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-0fd2cdbc-bf83-42d2-847a-a52dd65d4d6f tempest-CreateVolumesFromSnapshotTest-710952592 None] Created volume successfully. Sep 10 18:36:19 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9fa112ab-172d-4a5a-8108-1579850e017c" returned: 0 in 0.271s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-quobyte-9fa112ab-172d-4a5a-8108-1579850e017c" released by "delete_volume" :: held 0.677s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Created reservations ['833b7807-bf6d-4278-901e-6e7cb9fa3166', 'd86b27d5-be34-4292-a478-9c9aba7ff9a0', 'f6b1b557-ce44-4305-9766-e3e04c6777fd', '147fd521-f4a8-475b-a732-3f9da01e051c'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:19 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:36:19 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:19 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6 1073741824" returned: 0 in 0.501s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:19 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6 Sep 10 18:36:19 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:19 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.258s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:36:19 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Deleted volume successfully. Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ab17317-7567-41c7-846b-9582f320311b tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-9fa112ab-172d-4a5a-8108-1579850e017c-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "cinder-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "cinder-quobyte-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-quobyte-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609" acquired by "delete_volume" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5356cc-53fb-44d5-9d52-602b2a3d10bb]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:19 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6" returned: 0 in 0.285s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.756s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1550928480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08788f91-f905-4d39-8136-66dfdc13af01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8ce7ec4e504f9c93178eb411be9c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:15Z,use_quota=True,user_id='6b73a94dec89412e94cb0901c1fab693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Creating volume 08788f91-f905-4d39-8136-66dfdc13af01 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:36:19 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-08788f91-f905-4d39-8136-66dfdc13af01 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c425925c-a1a3-4fc6-bc76-80a05f5de7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:19 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-08788f91-f905-4d39-8136-66dfdc13af01 1073741824 Sep 10 18:36:19 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68479760-6927-41b9-9d7c-c8dd9dc4f85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:19 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Volume volume-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6 (6e9d3be4-3d5f-4536-b7e9-8320021eb4d6): created successfully Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68479760-6927-41b9-9d7c-c8dd9dc4f85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Flow 'volume_create_manager' (a414ffcd-8308-4d9d-97e0-a827431c0e4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:19 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609 Sep 10 18:36:19 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:19 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-be6fff58-590e-4055-babd-ee451232d985 tempest-CreateVolumesFromSnapshotTest-710952592 None] Created volume successfully. Sep 10 18:36:20 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609" returned: 0 in 0.389s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:20 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609 Sep 10 18:36:20 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:20 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-08788f91-f905-4d39-8136-66dfdc13af01 1073741824" returned: 0 in 0.431s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-08788f91-f905-4d39-8136-66dfdc13af01 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:20 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-08788f91-f905-4d39-8136-66dfdc13af01 Sep 10 18:36:20 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:20 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609" returned: 0 in 0.269s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-quobyte-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609" released by "delete_volume" :: held 0.696s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Created reservations ['85201d86-9923-4371-a72a-79806680f565', 'af19d85c-df75-4bfa-bc5e-bc2bd6ea297d', '48e7a5d3-77f3-4b53-9382-5ff0f1ed4f0c', 'c7eced92-91d0-4592-bfbd-592e304a81d5'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:20 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-08788f91-f905-4d39-8136-66dfdc13af01" returned: 0 in 0.275s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:20 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:36:20 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ab2492-75c6-4c6c-8290-5c3e2e413669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08788f91-f905-4d39-8136-66dfdc13af01', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a570ca0-4606-4f65-bf22-7f7a0f9d8c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:20 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Volume volume-08788f91-f905-4d39-8136-66dfdc13af01 (08788f91-f905-4d39-8136-66dfdc13af01): created successfully Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a570ca0-4606-4f65-bf22-7f7a0f9d8c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Flow 'volume_create_manager' (79e6aa56-6d11-496c-9bee-49caafcc3c8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:20 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-60b4e4ba-fead-40f2-a019-130a3f89772b tempest-CreateVolumesFromSnapshotTest-710952592 None] Created volume successfully. Sep 10 18:36:20 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.248s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:36:20 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Deleted volume successfully. Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e21eb7c6-9a6b-454f-b469-74dc6ff96e63 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-8445f3b2-d4c7-4ecd-a9e0-256e7e5bb609-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "cinder-c3f561a1-b5b8-495e-be91-0c9d7909fcff-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-c3f561a1-b5b8-495e-be91-0c9d7909fcff-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "cinder-quobyte-c3f561a1-b5b8-495e-be91-0c9d7909fcff" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-quobyte-c3f561a1-b5b8-495e-be91-0c9d7909fcff" acquired by "delete_volume" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7752460d-2832-4e20-a568-dab1347b6c17]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3f561a1-b5b8-495e-be91-0c9d7909fcff {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:21 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3f561a1-b5b8-495e-be91-0c9d7909fcff Sep 10 18:36:21 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:21 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3f561a1-b5b8-495e-be91-0c9d7909fcff" returned: 0 in 0.364s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3f561a1-b5b8-495e-be91-0c9d7909fcff {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:21 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3f561a1-b5b8-495e-be91-0c9d7909fcff Sep 10 18:36:21 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:21 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c3f561a1-b5b8-495e-be91-0c9d7909fcff" returned: 0 in 0.248s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "cinder-08788f91-f905-4d39-8136-66dfdc13af01-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-quobyte-c3f561a1-b5b8-495e-be91-0c9d7909fcff" released by "delete_volume" :: held 0.656s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-08788f91-f905-4d39-8136-66dfdc13af01-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "cinder-quobyte-08788f91-f905-4d39-8136-66dfdc13af01" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Created reservations ['c70f97ff-83c9-410d-aa0b-c5b01367cb28', 'ffd03e8a-df4e-44a2-ae1d-d83f763b348f', '395e9451-1922-4f4a-98a3-6565e42efde6', '0c5ceede-72fe-4916-af6c-5bd2e5da70cc'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-quobyte-08788f91-f905-4d39-8136-66dfdc13af01" acquired by "delete_volume" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c6e9ad-dc35-4f7f-8584-82afd5ffbef0]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-08788f91-f905-4d39-8136-66dfdc13af01 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:21 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:36:21 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:21 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-08788f91-f905-4d39-8136-66dfdc13af01 Sep 10 18:36:21 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:22 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "cinder-23ab9d29-384b-42ca-851c-414b7074bbb1-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.282s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:36:22 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Deleted volume successfully. Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-23ab9d29-384b-42ca-851c-414b7074bbb1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d6fe1fd3-d21c-4fd1-a174-ebcd28b3956a tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-c3f561a1-b5b8-495e-be91-0c9d7909fcff-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "cinder-quobyte-23ab9d29-384b-42ca-851c-414b7074bbb1" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-quobyte-23ab9d29-384b-42ca-851c-414b7074bbb1" acquired by "delete_volume" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:22 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-08788f91-f905-4d39-8136-66dfdc13af01" returned: 0 in 0.427s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-08788f91-f905-4d39-8136-66dfdc13af01 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2adf6e-4437-43d0-aa8f-f09386bf5b40]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23ab9d29-384b-42ca-851c-414b7074bbb1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:22 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-08788f91-f905-4d39-8136-66dfdc13af01 Sep 10 18:36:22 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:22 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23ab9d29-384b-42ca-851c-414b7074bbb1 Sep 10 18:36:22 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:22 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-08788f91-f905-4d39-8136-66dfdc13af01" returned: 0 in 0.258s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-quobyte-08788f91-f905-4d39-8136-66dfdc13af01" released by "delete_volume" :: held 0.728s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] Created reservations ['b3209d7c-e3cb-476a-8f89-9264b67a3886', '66b4f795-88e5-49de-933f-500f7974b526', 'd4a3c2aa-e273-4001-88d8-ae7fe9a1edda', '68b62666-358d-4e0d-938a-1bfbf6e80812'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:22 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23ab9d29-384b-42ca-851c-414b7074bbb1" returned: 0 in 0.396s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23ab9d29-384b-42ca-851c-414b7074bbb1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:22 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:36:22 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:22 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23ab9d29-384b-42ca-851c-414b7074bbb1 Sep 10 18:36:22 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "cinder-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:22 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.289s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "cinder-quobyte-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:22 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] Deleted volume successfully. Sep 10 18:36:22 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-23ab9d29-384b-42ca-851c-414b7074bbb1" returned: 0 in 0.293s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-quobyte-23ab9d29-384b-42ca-851c-414b7074bbb1" released by "delete_volume" :: held 0.736s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fba7a69b-5930-49af-8e1a-ddbce4283b6d tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-08788f91-f905-4d39-8136-66dfdc13af01-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-quobyte-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6" acquired by "delete_volume" :: waited 0.038s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f2d9dc-36a8-43b9-9b03-82ae2f527601]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:22 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Created reservations ['9c45d4d2-aa45-491f-b834-faf121422cd8', '60f8a745-e37b-4822-bdce-19fac67d3612', '67a5124f-4c1c-403a-a3d2-dc8635bb3b94', '62d12722-a789-4da2-a5ab-6aef6f0f243c'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:23 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6 Sep 10 18:36:23 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:23 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:36:23 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "cinder-f63c4cd6-010b-48c5-8dad-8b1ae254d32d-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:23 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-f63c4cd6-010b-48c5-8dad-8b1ae254d32d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.292s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:36:23 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Deleted volume successfully. Sep 10 18:36:23 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e063a786-ed8d-4239-ab21-acb6ffb45a66 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-23ab9d29-384b-42ca-851c-414b7074bbb1-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6" returned: 0 in 0.442s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:23 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6 Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "cinder-quobyte-f63c4cd6-010b-48c5-8dad-8b1ae254d32d" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:23 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-quobyte-f63c4cd6-010b-48c5-8dad-8b1ae254d32d" acquired by "delete_volume" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a672d8ea-2d31-40d6-a88b-8d970877e987]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f63c4cd6-010b-48c5-8dad-8b1ae254d32d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:23 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f63c4cd6-010b-48c5-8dad-8b1ae254d32d Sep 10 18:36:23 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:23 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6" returned: 0 in 0.258s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-quobyte-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6" released by "delete_volume" :: held 0.736s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] Created reservations ['8852efa4-e39a-4aaa-a38e-b0f31b804c09', 'c3ef70f3-562b-45e3-ae4a-156039b832b4', 'd1019b8e-27ec-4466-943e-582d7e5e618b', 'c38b9622-8e68-48d6-b310-be0c92a3a97b'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:23 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:36:23 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:23 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f63c4cd6-010b-48c5-8dad-8b1ae254d32d" returned: 0 in 0.377s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f63c4cd6-010b-48c5-8dad-8b1ae254d32d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:23 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f63c4cd6-010b-48c5-8dad-8b1ae254d32d Sep 10 18:36:23 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "cinder-0f24ea33-578e-4131-af75-0fd2c3543064-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-0f24ea33-578e-4131-af75-0fd2c3543064-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:24 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "cinder-quobyte-0f24ea33-578e-4131-af75-0fd2c3543064" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.277s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:36:24 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] Deleted volume successfully. Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-quobyte-0f24ea33-578e-4131-af75-0fd2c3543064" acquired by "delete_volume" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5eb7b0d1-debd-4e50-84a6-af58cf2ec3d3 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-6e9d3be4-3d5f-4536-b7e9-8320021eb4d6-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc59c66-8bec-475a-a9d3-1d99b58d3307]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0f24ea33-578e-4131-af75-0fd2c3543064 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:24 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f63c4cd6-010b-48c5-8dad-8b1ae254d32d" returned: 0 in 0.293s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-quobyte-f63c4cd6-010b-48c5-8dad-8b1ae254d32d" released by "delete_volume" :: held 0.710s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Created reservations ['005ff383-9dcb-4048-8c95-a1741e831735', 'e264fa8b-ca60-4082-b903-5ef626a1a843', 'bd89e576-89b5-452c-9bcc-3de5c6d5c57d', 'f2b4a119-abb5-409e-b2e4-365f2a32717a'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:36:24 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0f24ea33-578e-4131-af75-0fd2c3543064 Sep 10 18:36:24 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:24 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:36:24 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:24 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0f24ea33-578e-4131-af75-0fd2c3543064" returned: 0 in 0.381s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0f24ea33-578e-4131-af75-0fd2c3543064 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:24 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.267s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:36:24 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0f24ea33-578e-4131-af75-0fd2c3543064 Sep 10 18:36:24 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:24 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Deleted volume successfully. Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-72e25b69-b632-4fa9-8124-d03956bab400 tempest-CreateVolumesFromSourceVolumeTest-324329781 None] Lock "cinder-f63c4cd6-010b-48c5-8dad-8b1ae254d32d-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:24 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0f24ea33-578e-4131-af75-0fd2c3543064" returned: 0 in 0.272s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-quobyte-0f24ea33-578e-4131-af75-0fd2c3543064" released by "delete_volume" :: held 0.701s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] Created reservations ['f18fe9ac-f9b6-4a51-9761-d0ee5f50b658', '1581b9c7-d845-4e78-9f2c-673fffc5b8ea', 'f2e5c569-4210-4d51-8480-d9a5b661053c', 'bba997b4-8822-4bb2-a73b-49787249109e'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:24 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:36:24 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:25 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.256s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:25 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:36:25 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] Deleted volume successfully. Sep 10 18:36:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "cinder-278f98d5-6179-4efe-9bd5-c49351b81fe9-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5645fdc0-73e7-4f86-abe9-087fad6bef83 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-0f24ea33-578e-4131-af75-0fd2c3543064-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-278f98d5-6179-4efe-9bd5-c49351b81fe9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "cinder-quobyte-278f98d5-6179-4efe-9bd5-c49351b81fe9" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-quobyte-278f98d5-6179-4efe-9bd5-c49351b81fe9" acquired by "delete_volume" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:25 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8044be-0801-400b-ad39-577f301865a0]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-278f98d5-6179-4efe-9bd5-c49351b81fe9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:25 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-278f98d5-6179-4efe-9bd5-c49351b81fe9 Sep 10 18:36:25 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:25 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-278f98d5-6179-4efe-9bd5-c49351b81fe9" returned: 0 in 0.400s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-278f98d5-6179-4efe-9bd5-c49351b81fe9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:25 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-278f98d5-6179-4efe-9bd5-c49351b81fe9 Sep 10 18:36:25 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:25 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-278f98d5-6179-4efe-9bd5-c49351b81fe9" returned: 0 in 0.254s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-quobyte-278f98d5-6179-4efe-9bd5-c49351b81fe9" released by "delete_volume" :: held 0.699s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:26 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] Created reservations ['983f2472-e1c0-4bab-9f47-47b5ae36c461', '493bde7a-7c85-4f8e-a835-f475f812e299', '6bb9a70c-bbba-4fea-ba0a-d31b784c1ef1', '14829d32-88e5-4673-a2df-91170b63cb79'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:36:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:26 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:26 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:26 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:36:26 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:26 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.265s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:26 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:36:26 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] Deleted volume successfully. Sep 10 18:36:26 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "cinder-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:26 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-1cd27a93-d480-4733-86f1-dda877c52299 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-278f98d5-6179-4efe-9bd5-c49351b81fe9-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:26 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:26 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "cinder-quobyte-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:26 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-quobyte-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633" acquired by "delete_volume" :: waited 0.014s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:26 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[70926002-8581-4093-afa1-d1493f469432]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:26 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633 Sep 10 18:36:26 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:26 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633" returned: 0 in 0.362s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:26 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633 Sep 10 18:36:26 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:27 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633" returned: 0 in 0.246s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-quobyte-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633" released by "delete_volume" :: held 0.649s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] Created reservations ['677d1182-d340-4a5e-909f-53e1db252f57', 'ba1d0862-281f-46bb-a374-4bca5452b175', '5dfbee2e-52bd-49bc-8d9c-bf783457559d', '13067880-c018-4c02-8d02-ba0d85e6bcef'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:27 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:36:27 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:27 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.254s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:36:27 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] Deleted volume successfully. Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-af253676-6457-4072-a7d5-040c1374064b tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-a7b3bc95-b77d-4686-a3ad-21c2f4b3d633-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "cinder-8d3256ff-74a7-441b-b26f-fbff96d2d04b-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-8d3256ff-74a7-441b-b26f-fbff96d2d04b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "cinder-quobyte-0caf985c-c97e-46d4-ae71-15485541e9f5" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-quobyte-0caf985c-c97e-46d4-ae71-15485541e9f5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "cinder-quobyte-8d3256ff-74a7-441b-b26f-fbff96d2d04b" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-quobyte-8d3256ff-74a7-441b-b26f-fbff96d2d04b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] Deleting offline snapshot 8d3256ff-74a7-441b-b26f-fbff96d2d04b of volume 0caf985c-c97e-46d4-ae71-15485541e9f5 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] snapshot_file for this snap is: volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa81242f-7d5d-4579-8934-347a101f6810]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:27 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b Sep 10 18:36:27 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:27 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Flow 'volume_create_manager' (fa7c54b7-21f2-45d7-95bd-41f9cff4af16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207333b5-c9d9-42a4-8761-8bdf77dacd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207333b5-c9d9-42a4-8761-8bdf77dacd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-297472635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a3a349-9352-489a-96eb-bb5dc827b975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a667f5cf8f0e423484674c337fb8a877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:28Z,use_quota=True,user_id='57aa557f75bf47f59b32e49cbb5349a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78fc7f1-bb5b-438b-ae17-a5ec4e5cc677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78fc7f1-bb5b-438b-ae17-a5ec4e5cc677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f74c07-e187-4707-8bde-71684eb2473a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f74c07-e187-4707-8bde-71684eb2473a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5a3a349-9352-489a-96eb-bb5dc827b975', 'volume_name': 'volume-a5a3a349-9352-489a-96eb-bb5dc827b975', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badc2709-f996-405f-b412-95e08eac92a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badc2709-f996-405f-b412-95e08eac92a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c174782-028c-4297-9bf8-1205dbedbe5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:28 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Volume a5a3a349-9352-489a-96eb-bb5dc827b975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5a3a349-9352-489a-96eb-bb5dc827b975', 'volume_size': 1} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-297472635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a3a349-9352-489a-96eb-bb5dc827b975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a667f5cf8f0e423484674c337fb8a877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:28Z,use_quota=True,user_id='57aa557f75bf47f59b32e49cbb5349a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Creating volume a5a3a349-9352-489a-96eb-bb5dc827b975 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:36:28 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a5a3a349-9352-489a-96eb-bb5dc827b975 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:28 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b" returned: 0 in 0.412s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0caf985c-c97e-46d4-ae71-15485541e9f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:36:28 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a5a3a349-9352-489a-96eb-bb5dc827b975 1073741824 Sep 10 18:36:28 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6837f16b-155e-4fb1-b659-3d18bb03f567]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:28 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5 Sep 10 18:36:28 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:28 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a5a3a349-9352-489a-96eb-bb5dc827b975 1073741824" returned: 0 in 0.453s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:28 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5" returned: 0 in 0.410s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:28 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b Sep 10 18:36:28 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a5a3a349-9352-489a-96eb-bb5dc827b975 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:28 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a5a3a349-9352-489a-96eb-bb5dc827b975 Sep 10 18:36:28 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:28 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a5a3a349-9352-489a-96eb-bb5dc827b975" returned: 0 in 0.247s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c174782-028c-4297-9bf8-1205dbedbe5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5a3a349-9352-489a-96eb-bb5dc827b975', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cb78f0-3a4d-4a54-989d-5391ba07e0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:28 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Volume volume-a5a3a349-9352-489a-96eb-bb5dc827b975 (a5a3a349-9352-489a-96eb-bb5dc827b975): created successfully Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cb78f0-3a4d-4a54-989d-5391ba07e0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Flow 'volume_create_manager' (fa7c54b7-21f2-45d7-95bd-41f9cff4af16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:28 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b" returned: 0 in 0.334s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:28 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c8cca5ed-968d-4827-87b4-1aa2530d48d3 tempest-ProjectReaderTests-689632835 None] Created volume successfully. Sep 10 18:36:28 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b Sep 10 18:36:28 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:29 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:36:29 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:29 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5.8d3256ff-74a7-441b-b26f-fbff96d2d04b" returned: 0 in 0.265s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] Acquiring lock "cinder-a5a3a349-9352-489a-96eb-bb5dc827b975-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-quobyte-8d3256ff-74a7-441b-b26f-fbff96d2d04b" released by "_delete_snapshot" :: held 1.555s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] Lock "cinder-a5a3a349-9352-489a-96eb-bb5dc827b975-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-quobyte-0caf985c-c97e-46d4-ae71-15485541e9f5" released by "delete_snapshot" :: held 1.594s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] Acquiring lock "cinder-quobyte-a5a3a349-9352-489a-96eb-bb5dc827b975" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] Lock "cinder-quobyte-a5a3a349-9352-489a-96eb-bb5dc827b975" acquired by "delete_volume" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd352aac-9966-4317-87a7-6d2a108cd45a]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a5a3a349-9352-489a-96eb-bb5dc827b975 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] Created reservations ['9a5648fc-b715-418c-b615-d3523de661f2', 'c038562d-f59c-471d-8c7a-0a7682b19413', '23ac5cd9-e7ad-4f15-81c6-0e30926d4b95', '475f94e4-7f18-4f72-a4b2-06ac1c070645'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:36:29 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.281s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 28 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:36:29 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] Delete snapshot completed successfully. Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-728dec12-24dd-40be-85f0-c406b465ed98 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-8d3256ff-74a7-441b-b26f-fbff96d2d04b-delete_snapshot" released by "delete_snapshot" :: held 1.792s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:29 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a5a3a349-9352-489a-96eb-bb5dc827b975 Sep 10 18:36:29 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:29 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a5a3a349-9352-489a-96eb-bb5dc827b975" returned: 0 in 0.375s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a5a3a349-9352-489a-96eb-bb5dc827b975 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:29 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a5a3a349-9352-489a-96eb-bb5dc827b975 Sep 10 18:36:29 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "cinder-0caf985c-c97e-46d4-ae71-15485541e9f5-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-0caf985c-c97e-46d4-ae71-15485541e9f5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "cinder-quobyte-0caf985c-c97e-46d4-ae71-15485541e9f5" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-quobyte-0caf985c-c97e-46d4-ae71-15485541e9f5" acquired by "delete_volume" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4228272f-aaf3-4103-a1a9-c2da0def3ffa]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:29 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a5a3a349-9352-489a-96eb-bb5dc827b975" returned: 0 in 0.267s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:29 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5 Sep 10 18:36:29 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] Lock "cinder-quobyte-a5a3a349-9352-489a-96eb-bb5dc827b975" released by "delete_volume" :: held 0.692s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:29 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] Created reservations ['ade2e835-b440-4998-bbbc-dc68c231c1ee', '64069862-9276-423d-a02f-09681356d9ba', '92933f89-dc98-428b-97f1-cfb5629c9fda', 'daf167a5-fd54-4c99-9b2b-ed441887eab2'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:30 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:36:30 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:30 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5" returned: 0 in 0.385s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:30 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5 Sep 10 18:36:30 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:30 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.264s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:36:30 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] Deleted volume successfully. Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-036df954-cb70-4588-a911-54ece7b8c6c6 tempest-ProjectReaderTests-689632835 None] Lock "cinder-a5a3a349-9352-489a-96eb-bb5dc827b975-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:30 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0caf985c-c97e-46d4-ae71-15485541e9f5" returned: 0 in 0.253s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-quobyte-0caf985c-c97e-46d4-ae71-15485541e9f5" released by "delete_volume" :: held 0.700s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] Created reservations ['a7e5593b-09ff-40f1-80a1-1553386644e5', '07ccdce4-ff1e-48bd-b451-701c41b9444e', '9178bdb5-80c3-4cb8-89cb-011b901b0b83', 'e908e19e-37db-4ec5-aadb-4ebd275c0e41'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:30 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:36:30 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Flow 'volume_create_manager' (756802fd-2626-49b5-8df9-d362a4a16794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d020d99-7783-4bb1-983e-4b48d6d158d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d020d99-7783-4bb1-983e-4b48d6d158d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1628340643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9954eb-2b95-41c6-b6a7-85e769fd34a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a667f5cf8f0e423484674c337fb8a877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:31Z,use_quota=True,user_id='57aa557f75bf47f59b32e49cbb5349a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6c6189-fc70-4a36-915b-12e7307aae87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6c6189-fc70-4a36-915b-12e7307aae87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ac6221-0bf8-401e-b2dc-b30e61f59228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ac6221-0bf8-401e-b2dc-b30e61f59228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e9954eb-2b95-41c6-b6a7-85e769fd34a1', 'volume_name': 'volume-5e9954eb-2b95-41c6-b6a7-85e769fd34a1', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de9aad5d-f904-430f-adb4-23eb878af14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de9aad5d-f904-430f-adb4-23eb878af14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe01120-dd9d-4764-9623-5e53c4424079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:30 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Volume 5e9954eb-2b95-41c6-b6a7-85e769fd34a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e9954eb-2b95-41c6-b6a7-85e769fd34a1', 'volume_size': 1} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1628340643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9954eb-2b95-41c6-b6a7-85e769fd34a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a667f5cf8f0e423484674c337fb8a877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:31Z,use_quota=True,user_id='57aa557f75bf47f59b32e49cbb5349a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Creating volume 5e9954eb-2b95-41c6-b6a7-85e769fd34a1 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:36:30 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5e9954eb-2b95-41c6-b6a7-85e769fd34a1 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:30 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.261s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:36:30 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] Deleted volume successfully. Sep 10 18:36:30 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5e9954eb-2b95-41c6-b6a7-85e769fd34a1 1073741824 Sep 10 18:36:30 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:30 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b9551c7d-7ef2-4fa7-85d5-2b034525b381 tempest-CreateVolumesFromSnapshotTest-710952592 None] Lock "cinder-0caf985c-c97e-46d4-ae71-15485541e9f5-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:31 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5e9954eb-2b95-41c6-b6a7-85e769fd34a1 1073741824" returned: 0 in 0.486s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5e9954eb-2b95-41c6-b6a7-85e769fd34a1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:31 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5e9954eb-2b95-41c6-b6a7-85e769fd34a1 Sep 10 18:36:31 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:31 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5e9954eb-2b95-41c6-b6a7-85e769fd34a1" returned: 0 in 0.252s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:31 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:36:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:31 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe01120-dd9d-4764-9623-5e53c4424079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e9954eb-2b95-41c6-b6a7-85e769fd34a1', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:31 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28380ed6-143a-4975-ab54-14b0c0764a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:31 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Volume volume-5e9954eb-2b95-41c6-b6a7-85e769fd34a1 (5e9954eb-2b95-41c6-b6a7-85e769fd34a1): created successfully Sep 10 18:36:31 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28380ed6-143a-4975-ab54-14b0c0764a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:31 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Flow 'volume_create_manager' (756802fd-2626-49b5-8df9-d362a4a16794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:31 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-45a25a06-93f1-4eb1-a44a-a3768d563967 tempest-ProjectReaderTests-689632835 None] Created volume successfully. Sep 10 18:36:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] Acquiring lock "cinder-5e9954eb-2b95-41c6-b6a7-85e769fd34a1-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] Lock "cinder-5e9954eb-2b95-41c6-b6a7-85e769fd34a1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:32 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] Acquiring lock "cinder-quobyte-5e9954eb-2b95-41c6-b6a7-85e769fd34a1" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] Lock "cinder-quobyte-5e9954eb-2b95-41c6-b6a7-85e769fd34a1" acquired by "delete_volume" :: waited 0.015s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:33 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b1184e-c573-40d0-b256-f29344adbcf5]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5e9954eb-2b95-41c6-b6a7-85e769fd34a1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:33 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5e9954eb-2b95-41c6-b6a7-85e769fd34a1 Sep 10 18:36:33 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:33 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5e9954eb-2b95-41c6-b6a7-85e769fd34a1" returned: 0 in 0.358s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5e9954eb-2b95-41c6-b6a7-85e769fd34a1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:33 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5e9954eb-2b95-41c6-b6a7-85e769fd34a1 Sep 10 18:36:33 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:33 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5e9954eb-2b95-41c6-b6a7-85e769fd34a1" returned: 0 in 0.275s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] Lock "cinder-quobyte-5e9954eb-2b95-41c6-b6a7-85e769fd34a1" released by "delete_volume" :: held 0.673s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:33 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] Created reservations ['20fd1d04-ffcf-4e60-b2f5-5a3de52df9ed', '1a93227b-c1f7-4c07-a5ab-c9ecb3f409bb', '6c901c84-9c47-498a-b7c4-8ef959eaa1dd', '5531fbbc-de6b-42b7-847d-d163017494dd'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:36:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:33 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:36:33 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:34 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.265s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:34 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:36:34 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] Deleted volume successfully. Sep 10 18:36:34 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-25686fe3-b24b-4d87-80ec-88dd9f941c44 tempest-ProjectReaderTests-689632835 None] Lock "cinder-5e9954eb-2b95-41c6-b6a7-85e769fd34a1-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:36 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:36:36 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Flow 'volume_create_manager' (6186907b-9220-4e62-ba75-12e2162263c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:36 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa7b9500-a010-4699-baf5-edad22439556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:36 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa7b9500-a010-4699-baf5-edad22439556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b019c92-30ae-4d84-b4a7-7871f92be135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59879cb8ef4e4c2ba21e42a69995242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:36Z,use_quota=True,user_id='9c75ef82d33546b6b11bcdea2e2c86d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:36 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf07ae7-2974-4e75-acc2-8dfed189df9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:36 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf07ae7-2974-4e75-acc2-8dfed189df9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:36 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8941d1-da89-4e23-b89c-d890530d7776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:36 devstack cinder-volume[87842]: DEBUG cinder.image.glance [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Creating Keystone auth plugin from conf {{(pid=87842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 18:36:36 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8941d1-da89-4e23-b89c-d890530d7776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5b019c92-30ae-4d84-b4a7-7871f92be135', 'volume_name': 'volume-5b019c92-30ae-4d84-b4a7-7871f92be135', 'volume_size': 1, 'image_id': '6b5f689d-ac22-4fe2-b50c-674971e71633', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b5f689d-ac22-4fe2-b50c-674971e71633', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8de855780f56f6b0bd4a2f8e29e14170', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '59879cb8ef4e4c2ba21e42a69995242d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9b96c1f7640f48c990b4642092eae3aef8f3c044828e630a7ac9d11954ef1779a9d710191c6752a9712ccf3d5ebf0bb9792603f6fb1570b7e43a482cc60429f9', 'id': '6b5f689d-ac22-4fe2-b50c-674971e71633', 'created_at': datetime.datetime(2026, 9, 10, 16, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 36, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b5f689d-ac22-4fe2-b50c-674971e71633/file', 'properties': {}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:36 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ed13f8-b256-4910-a7a1-174fc2ce6b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:36 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ed13f8-b256-4910-a7a1-174fc2ce6b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:36 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c2896d-6f63-43b4-89af-c0825a3f938f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:36 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Volume 5b019c92-30ae-4d84-b4a7-7871f92be135: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5b019c92-30ae-4d84-b4a7-7871f92be135', 'volume_size': 1, 'image_id': '6b5f689d-ac22-4fe2-b50c-674971e71633', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b5f689d-ac22-4fe2-b50c-674971e71633', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8de855780f56f6b0bd4a2f8e29e14170', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '59879cb8ef4e4c2ba21e42a69995242d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9b96c1f7640f48c990b4642092eae3aef8f3c044828e630a7ac9d11954ef1779a9d710191c6752a9712ccf3d5ebf0bb9792603f6fb1570b7e43a482cc60429f9', 'id': '6b5f689d-ac22-4fe2-b50c-674971e71633', 'created_at': datetime.datetime(2026, 9, 10, 16, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 36, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b5f689d-ac22-4fe2-b50c-674971e71633/file', 'properties': {}}, 'image_service': } Sep 10 18:36:36 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Trying to clone 5b019c92-30ae-4d84-b4a7-7871f92be135 from image 6b5f689d-ac22-4fe2-b50c-674971e71633 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b5f689d-ac22-4fe2-b50c-674971e71633', 'metadata': {}}]). {{(pid=87842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 18:36:36 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 18:36:36 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Image download 0.00 MB at 0.00 MB/s Sep 10 18:36:36 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f35128-71ff-412e-b681-27deace17014]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:36 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD Sep 10 18:36:36 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:36 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:37 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD Sep 10 18:36:37 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:37 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:36:37 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Temporary image 6b5f689d-ac22-4fe2-b50c-674971e71633 is fetched for user 9c75ef82d33546b6b11bcdea2e2c86d9. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 18:36:37 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d558a0c3-2a9e-47f0-a583-7f54471ead67]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:37 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD Sep 10 18:36:37 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:37 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:37 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD Sep 10 18:36:37 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:38 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD" returned: 1 in 0.380s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b019c92-30ae-4d84-b4a7-7871f92be135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59879cb8ef4e4c2ba21e42a69995242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:36Z,use_quota=True,user_id='9c75ef82d33546b6b11bcdea2e2c86d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Creating volume 5b019c92-30ae-4d84-b4a7-7871f92be135 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:36:38 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5b019c92-30ae-4d84-b4a7-7871f92be135 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:38 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5b019c92-30ae-4d84-b4a7-7871f92be135 1073741824 Sep 10 18:36:38 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:38 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5b019c92-30ae-4d84-b4a7-7871f92be135 1073741824" returned: 0 in 0.433s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5b019c92-30ae-4d84-b4a7-7871f92be135 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:38 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5b019c92-30ae-4d84-b4a7-7871f92be135 Sep 10 18:36:38 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:38 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5b019c92-30ae-4d84-b4a7-7871f92be135" returned: 0 in 0.253s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Attempting download of 6b5f689d-ac22-4fe2-b50c-674971e71633 ((None, [{'url': 'file:///opt/stack/data/glance/images/6b5f689d-ac22-4fe2-b50c-674971e71633', 'metadata': {}}])) to volume 5b019c92-30ae-4d84-b4a7-7871f92be135. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[23916cd6-c6ed-4c0d-99de-666ff22efd92]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b5f689d-ac22-4fe2-b50c-674971e71633_3roxvcw9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:39 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b5f689d-ac22-4fe2-b50c-674971e71633_3roxvcw9 Sep 10 18:36:39 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:39 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b5f689d-ac22-4fe2-b50c-674971e71633_3roxvcw9" returned: 0 in 0.327s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b5f689d-ac22-4fe2-b50c-674971e71633_3roxvcw9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:39 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b5f689d-ac22-4fe2-b50c-674971e71633_3roxvcw9 Sep 10 18:36:39 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:39 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b5f689d-ac22-4fe2-b50c-674971e71633_3roxvcw9" returned: 1 in 0.331s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b5f689d-ac22-4fe2-b50c-674971e71633_3roxvcw9' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:36:39 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f466ed8-27c0-46c5-a4e3-b4ba31824d94]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:39 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD Sep 10 18:36:39 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:39 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:40 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD Sep 10 18:36:40 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:40 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:36:40 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] 6b5f689d-ac22-4fe2-b50c-674971e71633 was raw, converting to qcow2 {{(pid=87842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 18:36:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5b019c92-30ae-4d84-b4a7-7871f92be135 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:40 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5b019c92-30ae-4d84-b4a7-7871f92be135 Sep 10 18:36:40 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:40 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5b019c92-30ae-4d84-b4a7-7871f92be135" returned: 0 in 0.428s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:40 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b5f689d-ac22-4fe2-b50c-674971e71633_rmrj0c6qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5b019c92-30ae-4d84-b4a7-7871f92be135 {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:36:40 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 18:36:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5b019c92-30ae-4d84-b4a7-7871f92be135 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:40 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5b019c92-30ae-4d84-b4a7-7871f92be135 1G Sep 10 18:36:40 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:41 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5b019c92-30ae-4d84-b4a7-7871f92be135 1G" returned: 0 in 0.316s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:41 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Downloaded image 6b5f689d-ac22-4fe2-b50c-674971e71633 ((None, [{'url': 'file:///opt/stack/data/glance/images/6b5f689d-ac22-4fe2-b50c-674971e71633', 'metadata': {}}])) to volume 5b019c92-30ae-4d84-b4a7-7871f92be135 successfully. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 18:36:41 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Temporary image 6b5f689d-ac22-4fe2-b50c-674971e71633 for user 9c75ef82d33546b6b11bcdea2e2c86d9 is deleted. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 18:36:41 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Marking volume 5b019c92-30ae-4d84-b4a7-7871f92be135 as bootable. {{(pid=87842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 18:36:41 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Copying metadata from image 6b5f689d-ac22-4fe2-b50c-674971e71633 to 5b019c92-30ae-4d84-b4a7-7871f92be135. {{(pid=87842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 18:36:41 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Creating volume glance metadata for volume 5b019c92-30ae-4d84-b4a7-7871f92be135 backed by image 6b5f689d-ac22-4fe2-b50c-674971e71633 with: {'image_id': '6b5f689d-ac22-4fe2-b50c-674971e71633', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8de855780f56f6b0bd4a2f8e29e14170', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 18:36:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c2896d-6f63-43b4-89af-c0825a3f938f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b019c92-30ae-4d84-b4a7-7871f92be135', 'volume_size': 1, 'image_id': '6b5f689d-ac22-4fe2-b50c-674971e71633', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b5f689d-ac22-4fe2-b50c-674971e71633', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8de855780f56f6b0bd4a2f8e29e14170', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '59879cb8ef4e4c2ba21e42a69995242d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9b96c1f7640f48c990b4642092eae3aef8f3c044828e630a7ac9d11954ef1779a9d710191c6752a9712ccf3d5ebf0bb9792603f6fb1570b7e43a482cc60429f9', 'id': '6b5f689d-ac22-4fe2-b50c-674971e71633', 'created_at': datetime.datetime(2026, 9, 10, 16, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 36, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b5f689d-ac22-4fe2-b50c-674971e71633/file', 'properties': {}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9091e6-1319-45ef-a912-2673a83229db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:41 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Volume volume-5b019c92-30ae-4d84-b4a7-7871f92be135 (5b019c92-30ae-4d84-b4a7-7871f92be135): created successfully Sep 10 18:36:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9091e6-1319-45ef-a912-2673a83229db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:41 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Flow 'volume_create_manager' (6186907b-9220-4e62-ba75-12e2162263c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:41 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ec887b81-2aab-48f6-b533-4ba25c939503 tempest-VolumeImageDependencyTests-368487265 None] Created volume successfully. Sep 10 18:36:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] Acquiring lock "cinder-5b019c92-30ae-4d84-b4a7-7871f92be135-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] Lock "cinder-5b019c92-30ae-4d84-b4a7-7871f92be135-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] Acquiring lock "cinder-quobyte-5b019c92-30ae-4d84-b4a7-7871f92be135" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:36:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] Lock "cinder-quobyte-5b019c92-30ae-4d84-b4a7-7871f92be135" acquired by "delete_volume" :: waited 0.015s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:36:41 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41821d5-9c3c-4f32-8815-328865707f0e]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:36:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5b019c92-30ae-4d84-b4a7-7871f92be135 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:41 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5b019c92-30ae-4d84-b4a7-7871f92be135 Sep 10 18:36:41 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:42 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5b019c92-30ae-4d84-b4a7-7871f92be135" returned: 0 in 0.373s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5b019c92-30ae-4d84-b4a7-7871f92be135 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:42 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5b019c92-30ae-4d84-b4a7-7871f92be135 Sep 10 18:36:42 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:42 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5b019c92-30ae-4d84-b4a7-7871f92be135" returned: 0 in 0.246s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:42 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] Lock "cinder-quobyte-5b019c92-30ae-4d84-b4a7-7871f92be135" released by "delete_volume" :: held 0.663s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:42 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] Created reservations ['c32f9142-bb30-43e4-8049-4f1b577e1f1b', '814e4453-2e23-46dd-8ea9-b5ad088794c7', '5f8ff7f6-7522-45a6-b592-b568db065d04', '704c464b-47d5-4842-9379-160eb18a83b5'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:36:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:42 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:36:42 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:42 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.271s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:42 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:36:42 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] Deleted volume successfully. Sep 10 18:36:42 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d57c2e4b-f990-4ec4-9d7c-7a5492663ffb tempest-VolumeImageDependencyTests-368487265 None] Lock "cinder-5b019c92-30ae-4d84-b4a7-7871f92be135-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:36:52 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:UPDATE=235,cinder:SELECT=170,cinder:INSERT=63,cinder:DELETE=17 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:36:52 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=152,cinder:UPDATE=250,cinder:DELETE=26,cinder:INSERT=59 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:36:58 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:36:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Flow 'volume_create_manager' (f7d7b922-75ff-48e1-af02-e48edb221022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62513c2-aed0-41f7-83cb-ca1cf2c166a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62513c2-aed0-41f7-83cb-ca1cf2c166a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1337921781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96744572-9248-41b2-8e57-7a76112c2574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e962ef4339724834bcc2dc41d9f2c27b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:59Z,use_quota=True,user_id='c310fcd712434c4b8f7cb4c2a56c970b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80d65b4-86d4-4b0d-9d2c-115a11d058b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80d65b4-86d4-4b0d-9d2c-115a11d058b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0caf322-4304-4796-a962-d5ec7a59d23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0caf322-4304-4796-a962-d5ec7a59d23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96744572-9248-41b2-8e57-7a76112c2574', 'volume_name': 'volume-96744572-9248-41b2-8e57-7a76112c2574', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4b63e6-abf7-4f99-b0e1-82071edc4629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4b63e6-abf7-4f99-b0e1-82071edc4629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9bf72f2-bae6-4f61-a117-379901cc6ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:59 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Volume 96744572-9248-41b2-8e57-7a76112c2574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96744572-9248-41b2-8e57-7a76112c2574', 'volume_size': 1} Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1337921781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96744572-9248-41b2-8e57-7a76112c2574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e962ef4339724834bcc2dc41d9f2c27b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:36:59Z,use_quota=True,user_id='c310fcd712434c4b8f7cb4c2a56c970b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Creating volume 96744572-9248-41b2-8e57-7a76112c2574 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:36:59 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:59 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574 1073741824 Sep 10 18:36:59 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:59 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574 1073741824" returned: 0 in 0.406s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:36:59 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574 Sep 10 18:36:59 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:36:59 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574" returned: 0 in 0.245s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9bf72f2-bae6-4f61-a117-379901cc6ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96744572-9248-41b2-8e57-7a76112c2574', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da7a8155-2304-4c67-9905-39ee6adcfdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:36:59 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Volume volume-96744572-9248-41b2-8e57-7a76112c2574 (96744572-9248-41b2-8e57-7a76112c2574): created successfully Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da7a8155-2304-4c67-9905-39ee6adcfdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:36:59 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Flow 'volume_create_manager' (f7d7b922-75ff-48e1-af02-e48edb221022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:36:59 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4a20e3d6-1562-4540-8aaa-50d123ad8c64 tempest-SnapshotDependencyTests-157611315 None] Created volume successfully. Sep 10 18:37:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1556dc30-290c-4bf5-b3c5-20de37f038cd tempest-SnapshotDependencyTests-157611315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1556dc30-290c-4bf5-b3c5-20de37f038cd tempest-SnapshotDependencyTests-157611315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:00 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-1556dc30-290c-4bf5-b3c5-20de37f038cd tempest-SnapshotDependencyTests-157611315 None] Creating offline snapshot 2c07e301-f41b-4dec-a1ee-835aec84379c of volume 96744572-9248-41b2-8e57-7a76112c2574 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:37:00 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb827e35-07cc-447f-9c51-979d25b26ed0]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1556dc30-290c-4bf5-b3c5-20de37f038cd tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:00 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574 Sep 10 18:37:00 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:00 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1556dc30-290c-4bf5-b3c5-20de37f038cd tempest-SnapshotDependencyTests-157611315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574" returned: 0 in 0.365s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1556dc30-290c-4bf5-b3c5-20de37f038cd tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:00 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c 1G Sep 10 18:37:00 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:00 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1556dc30-290c-4bf5-b3c5-20de37f038cd tempest-SnapshotDependencyTests-157611315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c 1G" returned: 0 in 0.382s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1556dc30-290c-4bf5-b3c5-20de37f038cd tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96744572-9248-41b2-8e57-7a76112c2574 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:00 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96744572-9248-41b2-8e57-7a76112c2574 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c Sep 10 18:37:00 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:01 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1556dc30-290c-4bf5-b3c5-20de37f038cd tempest-SnapshotDependencyTests-157611315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96744572-9248-41b2-8e57-7a76112c2574 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c" returned: 0 in 0.292s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:01 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-1556dc30-290c-4bf5-b3c5-20de37f038cd tempest-SnapshotDependencyTests-157611315 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c is being set with open permissions: ugo+rw Sep 10 18:37:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1556dc30-290c-4bf5-b3c5-20de37f038cd tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:01 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c Sep 10 18:37:01 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:01 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1556dc30-290c-4bf5-b3c5-20de37f038cd tempest-SnapshotDependencyTests-157611315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c" returned: 0 in 0.244s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1556dc30-290c-4bf5-b3c5-20de37f038cd tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:01 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.info Sep 10 18:37:01 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:01 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1556dc30-290c-4bf5-b3c5-20de37f038cd tempest-SnapshotDependencyTests-157611315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.info" returned: 0 in 0.244s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:01 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-1556dc30-290c-4bf5-b3c5-20de37f038cd tempest-SnapshotDependencyTests-157611315 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.info is being set with open permissions: ugo+rw Sep 10 18:37:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1556dc30-290c-4bf5-b3c5-20de37f038cd tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:01 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.info Sep 10 18:37:01 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:01 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1556dc30-290c-4bf5-b3c5-20de37f038cd tempest-SnapshotDependencyTests-157611315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.info" returned: 0 in 0.236s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1556dc30-290c-4bf5-b3c5-20de37f038cd tempest-SnapshotDependencyTests-157611315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.843s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:02 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-1556dc30-290c-4bf5-b3c5-20de37f038cd tempest-SnapshotDependencyTests-157611315 None] Create snapshot completed successfully Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Flow 'volume_create_manager' (564b9c6d-b797-4614-ba91-10fe8b823ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7db1cd-0159-4641-891f-3f612a45ae95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7db1cd-0159-4641-891f-3f612a45ae95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0dd3a7-b96b-47e1-a872-1f736cef10dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e962ef4339724834bcc2dc41d9f2c27b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2c07e301-f41b-4dec-a1ee-835aec84379c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:03Z,use_quota=True,user_id='c310fcd712434c4b8f7cb4c2a56c970b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb3175f-7d39-43a0-a6c3-0ff7842bb41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb3175f-7d39-43a0-a6c3-0ff7842bb41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2291ef18-63f4-4d89-b0e7-f9ce1bb14c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2291ef18-63f4-4d89-b0e7-f9ce1bb14c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7f0dd3a7-b96b-47e1-a872-1f736cef10dd', 'volume_name': 'volume-7f0dd3a7-b96b-47e1-a872-1f736cef10dd', 'volume_size': 1, 'snapshot_id': '2c07e301-f41b-4dec-a1ee-835aec84379c'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e52213-def1-4a07-925c-8dc9b9543fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e52213-def1-4a07-925c-8dc9b9543fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c60cf6a4-7272-4e0b-b6af-979bfab6ed35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:02 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Volume 7f0dd3a7-b96b-47e1-a872-1f736cef10dd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7f0dd3a7-b96b-47e1-a872-1f736cef10dd', 'volume_size': 1, 'snapshot_id': '2c07e301-f41b-4dec-a1ee-835aec84379c'} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Acquiring lock "cinder-quobyte-2c07e301-f41b-4dec-a1ee-835aec84379c-7f0dd3a7-b96b-47e1-a872-1f736cef10dd" by "_create_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Lock "cinder-quobyte-2c07e301-f41b-4dec-a1ee-835aec84379c-7f0dd3a7-b96b-47e1-a872-1f736cef10dd" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Creating volume 7f0dd3a7-b96b-47e1-a872-1f736cef10dd from snapshot 2c07e301-f41b-4dec-a1ee-835aec84379c {{(pid=87842) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Acquiring lock "cinder-quobyte-7f0dd3a7-b96b-47e1-a872-1f736cef10dd" by "_copy_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Lock "cinder-quobyte-7f0dd3a7-b96b-47e1-a872-1f736cef10dd" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] snapshot: 2c07e301-f41b-4dec-a1ee-835aec84379c, volume: 7f0dd3a7-b96b-47e1-a872-1f736cef10dd, {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cf87db-825d-43b3-8c18-420a3621353b]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:03 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c Sep 10 18:37:03 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:03 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c" returned: 0 in 0.350s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96744572-9248-41b2-8e57-7a76112c2574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:37:03 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee074ac-5348-4d8e-a7c6-27ca9cdd506c]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:03 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574 Sep 10 18:37:03 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:03 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574" returned: 0 in 0.357s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574 {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 18:37:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Creating direct copy from snapshot {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 18:37:03 devstack cinder-volume[87842]: DEBUG cinder.utils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Path /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7f0dd3a7-b96b-47e1-a872-1f736cef10dd not found in is_blk_device check {{(pid=87842) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 18:37:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7f0dd3a7-b96b-47e1-a872-1f736cef10dd {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:03 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7f0dd3a7-b96b-47e1-a872-1f736cef10dd Sep 10 18:37:03 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:07 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7f0dd3a7-b96b-47e1-a872-1f736cef10dd" returned: 0 in 4.046s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:07 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Image conversion details: src /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574, size 1024.00 MB, duration 4.05 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7f0dd3a7-b96b-47e1-a872-1f736cef10dd {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:37:07 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Converted 1024.00 MB image at 252.98 MB/s Sep 10 18:37:07 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7f0dd3a7-b96b-47e1-a872-1f736cef10dd is being set with open permissions: ugo+rw Sep 10 18:37:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7f0dd3a7-b96b-47e1-a872-1f736cef10dd {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:07 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7f0dd3a7-b96b-47e1-a872-1f736cef10dd Sep 10 18:37:07 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:07 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7f0dd3a7-b96b-47e1-a872-1f736cef10dd" returned: 0 in 0.242s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Lock "cinder-quobyte-7f0dd3a7-b96b-47e1-a872-1f736cef10dd" released by "_copy_volume_from_snapshot" :: held 5.067s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Lock "cinder-quobyte-2c07e301-f41b-4dec-a1ee-835aec84379c-7f0dd3a7-b96b-47e1-a872-1f736cef10dd" released by "_create_volume_from_snapshot" :: held 5.126s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.141s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c60cf6a4-7272-4e0b-b6af-979bfab6ed35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f0dd3a7-b96b-47e1-a872-1f736cef10dd', 'volume_size': 1, 'snapshot_id': '2c07e301-f41b-4dec-a1ee-835aec84379c'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3aea28-4bc1-43fc-8735-78229133eaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:08 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Volume volume-7f0dd3a7-b96b-47e1-a872-1f736cef10dd (7f0dd3a7-b96b-47e1-a872-1f736cef10dd): created successfully Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3aea28-4bc1-43fc-8735-78229133eaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Flow 'volume_create_manager' (564b9c6d-b797-4614-ba91-10fe8b823ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:08 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-34004678-84ec-4191-9f0f-9c1fc54ec68c tempest-SnapshotDependencyTests-157611315 None] Created volume successfully. Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] Acquiring lock "cinder-2c07e301-f41b-4dec-a1ee-835aec84379c-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] Lock "cinder-2c07e301-f41b-4dec-a1ee-835aec84379c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] Acquiring lock "cinder-quobyte-96744572-9248-41b2-8e57-7a76112c2574" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] Lock "cinder-quobyte-96744572-9248-41b2-8e57-7a76112c2574" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] Acquiring lock "cinder-quobyte-2c07e301-f41b-4dec-a1ee-835aec84379c" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] Lock "cinder-quobyte-2c07e301-f41b-4dec-a1ee-835aec84379c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] Deleting offline snapshot 2c07e301-f41b-4dec-a1ee-835aec84379c of volume 96744572-9248-41b2-8e57-7a76112c2574 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] snapshot_file for this snap is: volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fdff23-b1d5-49c7-ac9b-018d5c2a116a]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:08 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c Sep 10 18:37:08 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:08 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c" returned: 0 in 0.353s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96744572-9248-41b2-8e57-7a76112c2574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bd9345-f694-4d0b-944d-5647b3a829f7]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:08 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574 Sep 10 18:37:08 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:09 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574" returned: 0 in 0.515s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:09 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c Sep 10 18:37:09 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:09 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c" returned: 0 in 0.315s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:09 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c Sep 10 18:37:09 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:09 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574.2c07e301-f41b-4dec-a1ee-835aec84379c" returned: 0 in 0.243s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] Lock "cinder-quobyte-2c07e301-f41b-4dec-a1ee-835aec84379c" released by "_delete_snapshot" :: held 1.519s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] Lock "cinder-quobyte-96744572-9248-41b2-8e57-7a76112c2574" released by "delete_snapshot" :: held 1.545s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:09 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] Created reservations ['828b43fd-d972-4048-8c21-b9c0ff4fa51d', 'f658505d-ca63-475e-833d-9825e2f9327b', '38f664ff-846e-4962-90d5-94484fc5424c', 'f8bd5ebb-d33c-4c2f-b5c6-740f54ae1347'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:37:10 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] Delete snapshot completed successfully. Sep 10 18:37:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fe3f09ed-90ce-408d-9d8e-f7a71d9a5899 tempest-SnapshotDependencyTests-157611315 None] Lock "cinder-2c07e301-f41b-4dec-a1ee-835aec84379c-delete_snapshot" released by "delete_snapshot" :: held 1.675s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] Acquiring lock "cinder-96744572-9248-41b2-8e57-7a76112c2574-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] Lock "cinder-96744572-9248-41b2-8e57-7a76112c2574-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] Acquiring lock "cinder-quobyte-96744572-9248-41b2-8e57-7a76112c2574" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] Lock "cinder-quobyte-96744572-9248-41b2-8e57-7a76112c2574" acquired by "delete_volume" :: waited 0.014s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:10 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f793f5c0-53c4-4f8e-addc-c8d0e6cc6756]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:10 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574 Sep 10 18:37:10 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:10 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574" returned: 0 in 0.345s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:10 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574 Sep 10 18:37:10 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:11 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-96744572-9248-41b2-8e57-7a76112c2574" returned: 0 in 0.250s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:11 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] Lock "cinder-quobyte-96744572-9248-41b2-8e57-7a76112c2574" released by "delete_volume" :: held 0.646s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:11 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] Created reservations ['ccd73b79-1495-43c0-8f17-d8feaa666aa6', 'c39c6310-c643-4661-bb9b-5f8b7940818c', '14e2c11e-4526-4c1f-a5e1-261a5f1b927e', '9924081d-43d7-459a-a4d4-461351a736a8'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:37:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:11 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:37:11 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:11 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.238s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:11 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:37:11 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] Deleted volume successfully. Sep 10 18:37:11 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5a98ce31-426f-4942-9b44-624024d512b1 tempest-SnapshotDependencyTests-157611315 None] Lock "cinder-96744572-9248-41b2-8e57-7a76112c2574-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:11 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] Acquiring lock "cinder-7f0dd3a7-b96b-47e1-a872-1f736cef10dd-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:11 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] Lock "cinder-7f0dd3a7-b96b-47e1-a872-1f736cef10dd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:11 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] Acquiring lock "cinder-quobyte-7f0dd3a7-b96b-47e1-a872-1f736cef10dd" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:11 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] Lock "cinder-quobyte-7f0dd3a7-b96b-47e1-a872-1f736cef10dd" acquired by "delete_volume" :: waited 0.015s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:11 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec7c736-4e80-45b2-b590-5d6daa085e5b]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7f0dd3a7-b96b-47e1-a872-1f736cef10dd {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:11 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7f0dd3a7-b96b-47e1-a872-1f736cef10dd Sep 10 18:37:11 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:12 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7f0dd3a7-b96b-47e1-a872-1f736cef10dd" returned: 0 in 0.352s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7f0dd3a7-b96b-47e1-a872-1f736cef10dd {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:12 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7f0dd3a7-b96b-47e1-a872-1f736cef10dd Sep 10 18:37:12 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:12 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7f0dd3a7-b96b-47e1-a872-1f736cef10dd" returned: 0 in 0.252s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] Lock "cinder-quobyte-7f0dd3a7-b96b-47e1-a872-1f736cef10dd" released by "delete_volume" :: held 0.642s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:12 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] Created reservations ['8d1e68be-b896-407e-956d-22e8886609a5', '9ab820dd-53d8-41bb-b686-73704084a029', '163dccee-189b-4cae-a454-1116ba774571', '585a3caf-d8c8-49c6-a002-01dd937011f0'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:37:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:12 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:37:12 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:12 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.248s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:12 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:37:12 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] Deleted volume successfully. Sep 10 18:37:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-148ac804-afc7-4eb0-9a7a-67419ad5b215 tempest-SnapshotDependencyTests-157611315 None] Lock "cinder-7f0dd3a7-b96b-47e1-a872-1f736cef10dd-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:22 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:UPDATE=29,cinder:SELECT=27,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:37:22 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=23,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:37:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:37:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:29 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:37:29 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:29 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.286s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:37:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:37:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 28 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:37:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Flow 'volume_create_manager' (5c04ce93-7cd6-4dfd-85c4-3d7f330da7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ad7b4d-fd8e-424d-ab6f-ba959a9145f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ad7b4d-fd8e-424d-ab6f-ba959a9145f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1158428109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e7e5aa4-e994-4bc6-9597-995130a3e54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53952dc18518437f9f9551eff2ce5631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:33Z,use_quota=True,user_id='b2a4493f055b418fa111485ce458a9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2284ff-7f8b-4336-bac1-23f569014df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2284ff-7f8b-4336-bac1-23f569014df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96210a4-d47b-48e9-8cd7-b1420656f1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96210a4-d47b-48e9-8cd7-b1420656f1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e7e5aa4-e994-4bc6-9597-995130a3e54d', 'volume_name': 'volume-9e7e5aa4-e994-4bc6-9597-995130a3e54d', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2c6f9c-ebae-4eb7-bb53-de09f65c1fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2c6f9c-ebae-4eb7-bb53-de09f65c1fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf16880-09b2-4a48-9261-49007ce4790e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:32 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Volume 9e7e5aa4-e994-4bc6-9597-995130a3e54d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e7e5aa4-e994-4bc6-9597-995130a3e54d', 'volume_size': 1} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1158428109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e7e5aa4-e994-4bc6-9597-995130a3e54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53952dc18518437f9f9551eff2ce5631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:33Z,use_quota=True,user_id='b2a4493f055b418fa111485ce458a9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Creating volume 9e7e5aa4-e994-4bc6-9597-995130a3e54d {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:32 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9e7e5aa4-e994-4bc6-9597-995130a3e54d 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:32 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9e7e5aa4-e994-4bc6-9597-995130a3e54d 1073741824 Sep 10 18:37:32 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Flow 'volume_create_manager' (9ffa4648-cdb3-49d3-bb96-99e77af13cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be1ce56-72a2-4103-b3a0-52b396066177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:32 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be1ce56-72a2-4103-b3a0-52b396066177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1345783205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188b2f6f-6a0b-4f04-a261-75a0bf9f34f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10734b644b0d4f4bb3f426b6d8f07b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:33Z,use_quota=True,user_id='ed84d5922c264eeba3732a78d054dd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (badf1d9d-a082-45ff-b1b3-6623c1dd011b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (badf1d9d-a082-45ff-b1b3-6623c1dd011b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38013346-31c3-406d-b14b-a867b8febada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38013346-31c3-406d-b14b-a867b8febada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '188b2f6f-6a0b-4f04-a261-75a0bf9f34f0', 'volume_name': 'volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e26cc55-341c-455e-86e6-813f8f8be080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e26cc55-341c-455e-86e6-813f8f8be080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6faed9ae-9692-4313-80b0-a72921796a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:33 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Volume 188b2f6f-6a0b-4f04-a261-75a0bf9f34f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0', 'volume_size': 1} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:33 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9e7e5aa4-e994-4bc6-9597-995130a3e54d 1073741824" returned: 0 in 0.712s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9e7e5aa4-e994-4bc6-9597-995130a3e54d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:33 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9e7e5aa4-e994-4bc6-9597-995130a3e54d Sep 10 18:37:33 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Flow 'volume_create_manager' (f42c9c57-bbf4-40c8-9756-5e6873ef8f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779f5108-d748-4f8c-9ff9-c34f00a1fdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779f5108-d748-4f8c-9ff9-c34f00a1fdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-248368384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2794562-9c03-4c69-b306-8ada9d92756a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53952dc18518437f9f9551eff2ce5631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:33Z,use_quota=True,user_id='b2a4493f055b418fa111485ce458a9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6199ace-8615-4ae1-b3b2-95266f4be3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6199ace-8615-4ae1-b3b2-95266f4be3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d2c3c7-767b-466e-b1d3-0f2671eb0aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d2c3c7-767b-466e-b1d3-0f2671eb0aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2794562-9c03-4c69-b306-8ada9d92756a', 'volume_name': 'volume-c2794562-9c03-4c69-b306-8ada9d92756a', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb377c5-b1a5-4b18-a0df-cf0e50e9c980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb377c5-b1a5-4b18-a0df-cf0e50e9c980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03e7604-f816-444e-93fe-72f4f8f24d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:33 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Volume c2794562-9c03-4c69-b306-8ada9d92756a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2794562-9c03-4c69-b306-8ada9d92756a', 'volume_size': 1} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Flow 'volume_create_manager' (c7ae310f-ec7f-4ffd-ad2a-c4eba73d733f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878e55cf-6377-4791-a5ad-369d795fb0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:33 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9e7e5aa4-e994-4bc6-9597-995130a3e54d" returned: 0 in 0.407s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.873s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1345783205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188b2f6f-6a0b-4f04-a261-75a0bf9f34f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10734b644b0d4f4bb3f426b6d8f07b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:33Z,use_quota=True,user_id='ed84d5922c264eeba3732a78d054dd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Creating volume 188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:33 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:34 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 1073741824 Sep 10 18:37:34 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878e55cf-6377-4791-a5ad-369d795fb0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1891137960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eaefdaf-580a-4fd2-8372-95cc4a6fc88d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea0523a8abf4954b3193862f279db42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:34Z,use_quota=True,user_id='5ef024936a574a9d934c7694abb3cde3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd6c1c9-62e8-4ccd-9136-389ce7f18ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd6c1c9-62e8-4ccd-9136-389ce7f18ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3dfbeeb-4f27-4ab3-9438-dd62e33072e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3dfbeeb-4f27-4ab3-9438-dd62e33072e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eaefdaf-580a-4fd2-8372-95cc4a6fc88d', 'volume_name': 'volume-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a6181f-79f7-4eec-b278-0ba40dc51daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a6181f-79f7-4eec-b278-0ba40dc51daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aef40cf-1ec1-493a-a53b-fa7fa84e8f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Volume 5eaefdaf-580a-4fd2-8372-95cc4a6fc88d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d', 'volume_size': 1} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf16880-09b2-4a48-9261-49007ce4790e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e7e5aa4-e994-4bc6-9597-995130a3e54d', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b583182-2f4f-410f-8fb9-05d2698997d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Volume volume-9e7e5aa4-e994-4bc6-9597-995130a3e54d (9e7e5aa4-e994-4bc6-9597-995130a3e54d): created successfully Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b583182-2f4f-410f-8fb9-05d2698997d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Flow 'volume_create_manager' (5c04ce93-7cd6-4dfd-85c4-3d7f330da7b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Flow 'volume_create_manager' (dbe96442-f73d-4ff1-9827-2c59cbb8f673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f835f6dd-c351-48d9-9bf2-19275ab5fe16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f835f6dd-c351-48d9-9bf2-19275ab5fe16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1007213974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc98947a-2784-4bf3-8527-74242f1b727b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53952dc18518437f9f9551eff2ce5631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:34Z,use_quota=True,user_id='b2a4493f055b418fa111485ce458a9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96269f20-0481-4c37-8d9a-bc2ca3c8679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96269f20-0481-4c37-8d9a-bc2ca3c8679d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec8f720-7ff0-48e7-8c7b-7b979e4abc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec8f720-7ff0-48e7-8c7b-7b979e4abc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc98947a-2784-4bf3-8527-74242f1b727b', 'volume_name': 'volume-bc98947a-2784-4bf3-8527-74242f1b727b', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3909b1ec-9e2e-4d39-9a5f-fa8ee97b51a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3909b1ec-9e2e-4d39-9a5f-fa8ee97b51a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814b8ca3-ef4d-48a2-a007-ea3876a62d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Volume bc98947a-2784-4bf3-8527-74242f1b727b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc98947a-2784-4bf3-8527-74242f1b727b', 'volume_size': 1} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:34 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-b82d5fd0-0e65-48fa-9a00-4ec55a6737c6 tempest-CreateVolumesFromImageTest-1260983047 None] Created volume successfully. Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Flow 'volume_create_manager' (fce9e9be-73de-4c8a-9fc4-1008a16defe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a127fd-8340-4d34-a682-06ac8ff8b0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a127fd-8340-4d34-a682-06ac8ff8b0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-743438577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea5d6d6-f4a0-47c3-9409-5b739c59213b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53952dc18518437f9f9551eff2ce5631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:34Z,use_quota=True,user_id='b2a4493f055b418fa111485ce458a9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ff66a7-568c-443e-8970-613abeb68867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ff66a7-568c-443e-8970-613abeb68867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2da9b2-d2f9-4bdd-9579-ea31eed990f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2da9b2-d2f9-4bdd-9579-ea31eed990f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ea5d6d6-f4a0-47c3-9409-5b739c59213b', 'volume_name': 'volume-1ea5d6d6-f4a0-47c3-9409-5b739c59213b', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae0580d5-8879-4d6e-94dc-4c240a3d19fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae0580d5-8879-4d6e-94dc-4c240a3d19fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f2aad0-5834-4e32-bc9a-b705f20e6755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Volume 1ea5d6d6-f4a0-47c3-9409-5b739c59213b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ea5d6d6-f4a0-47c3-9409-5b739c59213b', 'volume_size': 1} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:34 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 1073741824" returned: 0 in 0.667s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Flow 'volume_create_manager' (e42ba18e-b719-467a-ba37-7adf6328eca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dcd5314-ec02-4e3b-aefa-637b518178a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dcd5314-ec02-4e3b-aefa-637b518178a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1482941721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d19d88-1b21-40a3-8e41-8dfcb4b6888a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53952dc18518437f9f9551eff2ce5631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:35Z,use_quota=True,user_id='b2a4493f055b418fa111485ce458a9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:34 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 Sep 10 18:37:34 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029cdd80-0975-4734-bf64-f7ee193f437b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029cdd80-0975-4734-bf64-f7ee193f437b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6466873c-a6bc-4595-be23-53c6c5858e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6466873c-a6bc-4595-be23-53c6c5858e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85d19d88-1b21-40a3-8e41-8dfcb4b6888a', 'volume_name': 'volume-85d19d88-1b21-40a3-8e41-8dfcb4b6888a', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7820749-7d61-48e6-8d2e-736f8fddfb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7820749-7d61-48e6-8d2e-736f8fddfb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75f59b19-4eff-4f2a-803c-0872c207237d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:34 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Volume 85d19d88-1b21-40a3-8e41-8dfcb4b6888a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85d19d88-1b21-40a3-8e41-8dfcb4b6888a', 'volume_size': 1} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:34 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0" returned: 0 in 0.258s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.157s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-248368384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2794562-9c03-4c69-b306-8ada9d92756a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53952dc18518437f9f9551eff2ce5631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:33Z,use_quota=True,user_id='b2a4493f055b418fa111485ce458a9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Creating volume c2794562-9c03-4c69-b306-8ada9d92756a {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:34 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2794562-9c03-4c69-b306-8ada9d92756a 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6faed9ae-9692-4313-80b0-a72921796a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bbcfbcf-b39b-4efc-a5e4-b69b34bfba13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:35 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2794562-9c03-4c69-b306-8ada9d92756a 1073741824 Sep 10 18:37:35 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:35 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Volume volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 (188b2f6f-6a0b-4f04-a261-75a0bf9f34f0): created successfully Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bbcfbcf-b39b-4efc-a5e4-b69b34bfba13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Flow 'volume_create_manager' (9ffa4648-cdb3-49d3-bb96-99e77af13cd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:35 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f64c2522-31de-411d-bb1d-bc93f1daa896 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Created volume successfully. Sep 10 18:37:35 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2794562-9c03-4c69-b306-8ada9d92756a 1073741824" returned: 0 in 0.493s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2794562-9c03-4c69-b306-8ada9d92756a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:35 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2794562-9c03-4c69-b306-8ada9d92756a Sep 10 18:37:35 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-639d7a30-c410-4140-9bb6-1fc4c6c6cb50 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:35 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2794562-9c03-4c69-b306-8ada9d92756a" returned: 0 in 0.274s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.730s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1891137960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eaefdaf-580a-4fd2-8372-95cc4a6fc88d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea0523a8abf4954b3193862f279db42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:34Z,use_quota=True,user_id='5ef024936a574a9d934c7694abb3cde3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Creating volume 5eaefdaf-580a-4fd2-8372-95cc4a6fc88d {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:35 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03e7604-f816-444e-93fe-72f4f8f24d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2794562-9c03-4c69-b306-8ada9d92756a', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcb8883-91ef-4c00-938f-a961d796b0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:35 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d 1073741824 Sep 10 18:37:35 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:35 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Volume volume-c2794562-9c03-4c69-b306-8ada9d92756a (c2794562-9c03-4c69-b306-8ada9d92756a): created successfully Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcb8883-91ef-4c00-938f-a961d796b0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:35 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Flow 'volume_create_manager' (f42c9c57-bbf4-40c8-9756-5e6873ef8f89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:35 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-cdb059ad-a69f-46d9-b11c-027bf0e7d16e tempest-CreateVolumesFromImageTest-1260983047 None] Created volume successfully. Sep 10 18:37:36 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d 1073741824" returned: 0 in 0.524s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:36 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d Sep 10 18:37:36 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:36 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d" returned: 0 in 0.271s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.441s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1007213974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc98947a-2784-4bf3-8527-74242f1b727b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53952dc18518437f9f9551eff2ce5631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:34Z,use_quota=True,user_id='b2a4493f055b418fa111485ce458a9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Creating volume bc98947a-2784-4bf3-8527-74242f1b727b {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:36 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-bc98947a-2784-4bf3-8527-74242f1b727b 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:36 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aef40cf-1ec1-493a-a53b-fa7fa84e8f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:36 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6bc756-df98-4b48-8134-1f2da13dd0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:36 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-bc98947a-2784-4bf3-8527-74242f1b727b 1073741824 Sep 10 18:37:36 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:36 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Volume volume-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d (5eaefdaf-580a-4fd2-8372-95cc4a6fc88d): created successfully Sep 10 18:37:36 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6bc756-df98-4b48-8134-1f2da13dd0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:36 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Flow 'volume_create_manager' (c7ae310f-ec7f-4ffd-ad2a-c4eba73d733f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:36 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-fd2dc8ad-2dd3-48ed-88eb-39ae5299f302 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Created volume successfully. Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Flow 'volume_create_manager' (19dc4843-d459-43a4-a038-90998ff41cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e02b8210-583f-43c5-bd22-d193ddd26d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:37 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e02b8210-583f-43c5-bd22-d193ddd26d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00de4c53f5f8415199db055eec8a1cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:37Z,use_quota=True,user_id='c0006ae958b448db9d85d05502abbf4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b061888d-f2e3-461a-bba2-ed00740e516e),volume_type_id=b061888d-f2e3-461a-bba2-ed00740e516e)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38cc639-1b78-4210-aba3-5b8e66050b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38cc639-1b78-4210-aba3-5b8e66050b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93890629-d2a1-4284-bcaf-284f49528686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.image.glance [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Creating Keystone auth plugin from conf {{(pid=87842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-bc98947a-2784-4bf3-8527-74242f1b727b 1073741824" returned: 0 in 0.495s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-bc98947a-2784-4bf3-8527-74242f1b727b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:37 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-bc98947a-2784-4bf3-8527-74242f1b727b Sep 10 18:37:37 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93890629-d2a1-4284-bcaf-284f49528686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45', 'volume_name': 'volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45', 'volume_size': 1, 'image_id': 'b5355ec9-1a4a-4aae-bb5d-edc1c599eb80', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5355ec9-1a4a-4aae-bb5d-edc1c599eb80', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71f45c0ac0019871fab5d52b78ed687d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '00de4c53f5f8415199db055eec8a1cc7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '66267fd6f3ca0997f457784319cf5d9f0c083ad0dd4a81236bbc5341a01555b4b9d167b1472b309f79ba55e40f59fc2f761d24af8b5d58d6e0b66d60bff8bb89', 'id': 'b5355ec9-1a4a-4aae-bb5d-edc1c599eb80', 'created_at': datetime.datetime(2026, 9, 10, 16, 37, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 37, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5355ec9-1a4a-4aae-bb5d-edc1c599eb80/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (705a080d-a1c7-4219-8048-709928b5c8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (705a080d-a1c7-4219-8048-709928b5c8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db393f31-d81e-4dac-acbc-e6fb27b26880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:37 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Volume 85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45', 'volume_size': 1, 'image_id': 'b5355ec9-1a4a-4aae-bb5d-edc1c599eb80', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5355ec9-1a4a-4aae-bb5d-edc1c599eb80', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71f45c0ac0019871fab5d52b78ed687d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '00de4c53f5f8415199db055eec8a1cc7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '66267fd6f3ca0997f457784319cf5d9f0c083ad0dd4a81236bbc5341a01555b4b9d167b1472b309f79ba55e40f59fc2f761d24af8b5d58d6e0b66d60bff8bb89', 'id': 'b5355ec9-1a4a-4aae-bb5d-edc1c599eb80', 'created_at': datetime.datetime(2026, 9, 10, 16, 37, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 37, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5355ec9-1a4a-4aae-bb5d-edc1c599eb80/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Trying to clone 85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 from image b5355ec9-1a4a-4aae-bb5d-edc1c599eb80 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5355ec9-1a4a-4aae-bb5d-edc1c599eb80', 'metadata': {}}]). {{(pid=87842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 18:37:37 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-bc98947a-2784-4bf3-8527-74242f1b727b" returned: 0 in 0.250s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.042s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-743438577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea5d6d6-f4a0-47c3-9409-5b739c59213b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53952dc18518437f9f9551eff2ce5631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:34Z,use_quota=True,user_id='b2a4493f055b418fa111485ce458a9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Creating volume 1ea5d6d6-f4a0-47c3-9409-5b739c59213b {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:37 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1ea5d6d6-f4a0-47c3-9409-5b739c59213b 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:37 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1ea5d6d6-f4a0-47c3-9409-5b739c59213b 1073741824 Sep 10 18:37:37 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814b8ca3-ef4d-48a2-a007-ea3876a62d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc98947a-2784-4bf3-8527-74242f1b727b', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb491ba-cd05-42b1-bbef-a79dbc329543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 18:37:37 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Image download 0.00 MB at 0.00 MB/s Sep 10 18:37:37 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Volume volume-bc98947a-2784-4bf3-8527-74242f1b727b (bc98947a-2784-4bf3-8527-74242f1b727b): created successfully Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb491ba-cd05-42b1-bbef-a79dbc329543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Flow 'volume_create_manager' (dbe96442-f73d-4ff1-9827-2c59cbb8f673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:37 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-a5c3b730-0d1d-4498-a594-5a7555026c01 tempest-CreateVolumesFromImageTest-1260983047 None] Created volume successfully. Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ecfb19-4a0b-4224-9257-06d2f78c5fc4]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:37 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD Sep 10 18:37:37 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:37 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:38 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1ea5d6d6-f4a0-47c3-9409-5b739c59213b 1073741824" returned: 0 in 0.513s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1ea5d6d6-f4a0-47c3-9409-5b739c59213b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:38 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1ea5d6d6-f4a0-47c3-9409-5b739c59213b Sep 10 18:37:38 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:38 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD Sep 10 18:37:38 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:38 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:38 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Flow 'volume_create_manager' (e9f60dea-8b93-49ea-931b-c242e76a452b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f52d136-3c5e-4e7b-a45b-1ecbcc62b61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1ea5d6d6-f4a0-47c3-9409-5b739c59213b" returned: 0 in 0.311s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD" returned: 1 in 0.392s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Temporary image b5355ec9-1a4a-4aae-bb5d-edc1c599eb80 is fetched for user c0006ae958b448db9d85d05502abbf4b. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.585s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1482941721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d19d88-1b21-40a3-8e41-8dfcb4b6888a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53952dc18518437f9f9551eff2ce5631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:35Z,use_quota=True,user_id='b2a4493f055b418fa111485ce458a9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Creating volume 85d19d88-1b21-40a3-8e41-8dfcb4b6888a {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:38 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85d19d88-1b21-40a3-8e41-8dfcb4b6888a 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f52d136-3c5e-4e7b-a45b-1ecbcc62b61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-372186456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb04109-8008-487f-80fe-8afc1ed7517c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea0523a8abf4954b3193862f279db42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:38Z,use_quota=True,user_id='5ef024936a574a9d934c7694abb3cde3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (406b703c-8f3f-464f-86ae-ff4f105dc355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (406b703c-8f3f-464f-86ae-ff4f105dc355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:38 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85d19d88-1b21-40a3-8e41-8dfcb4b6888a 1073741824 Sep 10 18:37:38 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ca1b88-295f-4a98-9f18-d202783e9a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ca1b88-295f-4a98-9f18-d202783e9a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb04109-8008-487f-80fe-8afc1ed7517c', 'volume_name': 'volume-cbb04109-8008-487f-80fe-8afc1ed7517c', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f4a110-f38e-4f48-97a7-6ded1af6173b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f4a110-f38e-4f48-97a7-6ded1af6173b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00093f4f-8db6-49bf-9d17-66270044323c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:38 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Volume cbb04109-8008-487f-80fe-8afc1ed7517c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb04109-8008-487f-80fe-8afc1ed7517c', 'volume_size': 1} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f2aad0-5834-4e32-bc9a-b705f20e6755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ea5d6d6-f4a0-47c3-9409-5b739c59213b', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff4ee5d-553b-4151-a923-34ef6200e8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:38 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Volume volume-1ea5d6d6-f4a0-47c3-9409-5b739c59213b (1ea5d6d6-f4a0-47c3-9409-5b739c59213b): created successfully Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff4ee5d-553b-4151-a923-34ef6200e8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Flow 'volume_create_manager' (fce9e9be-73de-4c8a-9fc4-1008a16defe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:38 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c7733ede-2f84-4937-8f8b-d110467b1b3a tempest-CreateVolumesFromImageTest-1260983047 None] Created volume successfully. Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6527c87e-d244-4461-be19-fdcf2dc87690]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:38 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD Sep 10 18:37:38 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Flow 'volume_create_manager' (0e7b8823-6bb2-4f1d-b4ad-a8b34218b11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614354b9-cb06-4b8e-8680-0c4cfae2732c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614354b9-cb06-4b8e-8680-0c4cfae2732c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-52892195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea0523a8abf4954b3193862f279db42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:39Z,use_quota=True,user_id='5ef024936a574a9d934c7694abb3cde3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf0d7d1-a39c-4733-996b-236975ded122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf0d7d1-a39c-4733-996b-236975ded122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698b44c6-0811-4ad5-b786-76f358566432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698b44c6-0811-4ad5-b786-76f358566432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2', 'volume_name': 'volume-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e6c9c6-4e3e-4c24-8da5-e8c68a1377a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e6c9c6-4e3e-4c24-8da5-e8c68a1377a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f2157ee-e1a1-4f18-88e4-d535d511c51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:38 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Volume 4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2', 'volume_size': 1} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:38 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:38 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85d19d88-1b21-40a3-8e41-8dfcb4b6888a 1073741824" returned: 0 in 0.545s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85d19d88-1b21-40a3-8e41-8dfcb4b6888a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:39 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85d19d88-1b21-40a3-8e41-8dfcb4b6888a Sep 10 18:37:39 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:39 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD Sep 10 18:37:39 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Flow 'volume_create_manager' (39bd2b9c-deec-403b-bb64-d1debacc9368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5b7ec6-9839-4576-83f1-d9cd5e078f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5b7ec6-9839-4576-83f1-d9cd5e078f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1849241224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7ddca4-65bb-493e-8bdc-ea0be495162e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea0523a8abf4954b3193862f279db42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:39Z,use_quota=True,user_id='5ef024936a574a9d934c7694abb3cde3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c1eca1-fe7d-496e-a21a-fdbc8b4bbdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c1eca1-fe7d-496e-a21a-fdbc8b4bbdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d344c4d-213a-4bf1-8776-3824825cb69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d344c4d-213a-4bf1-8776-3824825cb69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b7ddca4-65bb-493e-8bdc-ea0be495162e', 'volume_name': 'volume-2b7ddca4-65bb-493e-8bdc-ea0be495162e', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71accf5-0147-4c57-814c-8a998ed0847a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71accf5-0147-4c57-814c-8a998ed0847a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30734415-b6fc-461c-ba1f-9ea94abcdbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:39 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Volume 2b7ddca4-65bb-493e-8bdc-ea0be495162e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b7ddca4-65bb-493e-8bdc-ea0be495162e', 'volume_size': 1} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:39 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85d19d88-1b21-40a3-8e41-8dfcb4b6888a" returned: 0 in 0.336s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-639d7a30-c410-4140-9bb6-1fc4c6c6cb50 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.709s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75f59b19-4eff-4f2a-803c-0872c207237d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85d19d88-1b21-40a3-8e41-8dfcb4b6888a', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:39 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823e71c7-1959-4cd8-ae5f-9689584195bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD" returned: 1 in 0.436s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-639d7a30-c410-4140-9bb6-1fc4c6c6cb50 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Creating offline snapshot a2876934-664a-4898-a656-539a7d76e687 of volume 188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:37:39 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Volume volume-85d19d88-1b21-40a3-8e41-8dfcb4b6888a (85d19d88-1b21-40a3-8e41-8dfcb4b6888a): created successfully Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823e71c7-1959-4cd8-ae5f-9689584195bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Flow 'volume_create_manager' (e42ba18e-b719-467a-ba37-7adf6328eca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9130f4de-8736-463e-a972-2f278afe73b9]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-639d7a30-c410-4140-9bb6-1fc4c6c6cb50 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:39 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-dcb1555a-473f-43f3-b02f-bd2e276b8f3d tempest-CreateVolumesFromImageTest-1260983047 None] Created volume successfully. Sep 10 18:37:39 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 Sep 10 18:37:39 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Flow 'volume_create_manager' (345486b4-5e06-494a-a6b8-17a3b390a4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab5b383-99ce-410a-8949-a9683be6a212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab5b383-99ce-410a-8949-a9683be6a212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2012288347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f06069-d402-489b-b049-e886c45941cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea0523a8abf4954b3193862f279db42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:40Z,use_quota=True,user_id='5ef024936a574a9d934c7694abb3cde3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a70cc01-b77e-4153-8230-dc0d273e0f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a70cc01-b77e-4153-8230-dc0d273e0f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885492e8-9a42-4361-8dbd-27e0b24ba9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885492e8-9a42-4361-8dbd-27e0b24ba9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f06069-d402-489b-b049-e886c45941cc', 'volume_name': 'volume-29f06069-d402-489b-b049-e886c45941cc', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4804628-2c6a-4929-b8a7-b264531eac9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4804628-2c6a-4929-b8a7-b264531eac9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06e5896f-c956-4d24-a20f-6282b4d87671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:39 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Volume 29f06069-d402-489b-b049-e886c45941cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f06069-d402-489b-b049-e886c45941cc', 'volume_size': 1} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:39 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-639d7a30-c410-4140-9bb6-1fc4c6c6cb50 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0" returned: 0 in 0.436s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-639d7a30-c410-4140-9bb6-1fc4c6c6cb50 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:39 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687 1G Sep 10 18:37:39 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Flow 'volume_create_manager' (55e65c21-f09d-4a49-b0cb-be71f14b155e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2918d5c-7514-496b-9b32-74731b6c8471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2918d5c-7514-496b-9b32-74731b6c8471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-6188024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0e3b40-d460-437d-b9ec-9cebd9dbe268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea0523a8abf4954b3193862f279db42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:40Z,use_quota=True,user_id='5ef024936a574a9d934c7694abb3cde3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5103015e-6a8a-4fbd-a7f4-a91e97962f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5103015e-6a8a-4fbd-a7f4-a91e97962f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f53854-2484-4385-9b6e-c971025e9d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f53854-2484-4385-9b6e-c971025e9d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d0e3b40-d460-437d-b9ec-9cebd9dbe268', 'volume_name': 'volume-2d0e3b40-d460-437d-b9ec-9cebd9dbe268', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b753ec60-6151-407c-80e2-83e7fadb25e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b753ec60-6151-407c-80e2-83e7fadb25e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89362c4a-e7ce-4b07-9e89-fb5adf51b8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:40 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Volume 2d0e3b40-d460-437d-b9ec-9cebd9dbe268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d0e3b40-d460-437d-b9ec-9cebd9dbe268', 'volume_size': 1} Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:40 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-639d7a30-c410-4140-9bb6-1fc4c6c6cb50 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687 1G" returned: 0 in 0.390s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-639d7a30-c410-4140-9bb6-1fc4c6c6cb50 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:40 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687 Sep 10 18:37:40 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "cinder-85d19d88-1b21-40a3-8e41-8dfcb4b6888a-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-85d19d88-1b21-40a3-8e41-8dfcb4b6888a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "cinder-quobyte-85d19d88-1b21-40a3-8e41-8dfcb4b6888a" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-quobyte-85d19d88-1b21-40a3-8e41-8dfcb4b6888a" acquired by "delete_volume" :: waited 0.013s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[94558d1f-fb38-4d33-8192-046f5cfbe132]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85d19d88-1b21-40a3-8e41-8dfcb4b6888a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:40 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85d19d88-1b21-40a3-8e41-8dfcb4b6888a Sep 10 18:37:40 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:40 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-639d7a30-c410-4140-9bb6-1fc4c6c6cb50 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687" returned: 0 in 0.313s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:40 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-639d7a30-c410-4140-9bb6-1fc4c6c6cb50 tempest-CreateVolumesFromSnapshotTest-1833431004 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687 is being set with open permissions: ugo+rw Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-639d7a30-c410-4140-9bb6-1fc4c6c6cb50 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:40 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687 Sep 10 18:37:40 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:40 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85d19d88-1b21-40a3-8e41-8dfcb4b6888a" returned: 0 in 0.364s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85d19d88-1b21-40a3-8e41-8dfcb4b6888a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:40 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-639d7a30-c410-4140-9bb6-1fc4c6c6cb50 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687" returned: 0 in 0.242s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:40 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85d19d88-1b21-40a3-8e41-8dfcb4b6888a Sep 10 18:37:40 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-639d7a30-c410-4140-9bb6-1fc4c6c6cb50 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:40 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.info Sep 10 18:37:40 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:41 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85d19d88-1b21-40a3-8e41-8dfcb4b6888a" returned: 0 in 0.250s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-quobyte-85d19d88-1b21-40a3-8e41-8dfcb4b6888a" released by "delete_volume" :: held 0.658s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:41 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-639d7a30-c410-4140-9bb6-1fc4c6c6cb50 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.info" returned: 0 in 0.274s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:41 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-639d7a30-c410-4140-9bb6-1fc4c6c6cb50 tempest-CreateVolumesFromSnapshotTest-1833431004 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.info is being set with open permissions: ugo+rw Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-639d7a30-c410-4140-9bb6-1fc4c6c6cb50 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] Created reservations ['33800f2c-c698-4bb6-80f0-b5773cffb017', '1f0e3a80-cc07-440d-b1b4-6fcec57f8717', '41fc1068-cdd7-4e04-9668-e95a8703d9d8', '6c8dd060-75d9-4f75-8ae4-b0ff0395cc30'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:37:41 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.info Sep 10 18:37:41 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:41 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:37:41 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:41 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-639d7a30-c410-4140-9bb6-1fc4c6c6cb50 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.info" returned: 0 in 0.254s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-639d7a30-c410-4140-9bb6-1fc4c6c6cb50 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.940s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-372186456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb04109-8008-487f-80fe-8afc1ed7517c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea0523a8abf4954b3193862f279db42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:38Z,use_quota=True,user_id='5ef024936a574a9d934c7694abb3cde3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Creating volume cbb04109-8008-487f-80fe-8afc1ed7517c {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:41 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cbb04109-8008-487f-80fe-8afc1ed7517c 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:41 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cbb04109-8008-487f-80fe-8afc1ed7517c 1073741824 Sep 10 18:37:41 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:41 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.273s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:37:41 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-639d7a30-c410-4140-9bb6-1fc4c6c6cb50 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Create snapshot completed successfully Sep 10 18:37:41 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] Deleted volume successfully. Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "cinder-1ea5d6d6-f4a0-47c3-9409-5b739c59213b-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-93424d8c-e685-4d08-b9d2-f13e0350dbe1 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-85d19d88-1b21-40a3-8e41-8dfcb4b6888a-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-1ea5d6d6-f4a0-47c3-9409-5b739c59213b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "cinder-quobyte-1ea5d6d6-f4a0-47c3-9409-5b739c59213b" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-quobyte-1ea5d6d6-f4a0-47c3-9409-5b739c59213b" acquired by "delete_volume" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de34858-bbc1-474a-8406-9da26ab799ec]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1ea5d6d6-f4a0-47c3-9409-5b739c59213b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:41 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1ea5d6d6-f4a0-47c3-9409-5b739c59213b Sep 10 18:37:41 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:41 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cbb04109-8008-487f-80fe-8afc1ed7517c 1073741824" returned: 0 in 0.481s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cbb04109-8008-487f-80fe-8afc1ed7517c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:41 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cbb04109-8008-487f-80fe-8afc1ed7517c Sep 10 18:37:41 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:41 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1ea5d6d6-f4a0-47c3-9409-5b739c59213b" returned: 0 in 0.401s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1ea5d6d6-f4a0-47c3-9409-5b739c59213b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:42 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1ea5d6d6-f4a0-47c3-9409-5b739c59213b Sep 10 18:37:42 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:42 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cbb04109-8008-487f-80fe-8afc1ed7517c" returned: 0 in 0.303s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.400s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-52892195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea0523a8abf4954b3193862f279db42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:39Z,use_quota=True,user_id='5ef024936a574a9d934c7694abb3cde3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Creating volume 4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:42 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00093f4f-8db6-49bf-9d17-66270044323c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb04109-8008-487f-80fe-8afc1ed7517c', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:42 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9e9efb-6792-4adf-851b-5ea5c94da976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:42 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2 1073741824 Sep 10 18:37:42 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1ea5d6d6-f4a0-47c3-9409-5b739c59213b" returned: 0 in 0.304s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:42 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Volume volume-cbb04109-8008-487f-80fe-8afc1ed7517c (cbb04109-8008-487f-80fe-8afc1ed7517c): created successfully Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9e9efb-6792-4adf-851b-5ea5c94da976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Flow 'volume_create_manager' (e9f60dea-8b93-49ea-931b-c242e76a452b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-quobyte-1ea5d6d6-f4a0-47c3-9409-5b739c59213b" released by "delete_volume" :: held 0.777s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:42 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-28588430-52f8-4393-9a24-8ca456adeb66 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Created volume successfully. Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] Created reservations ['a1f7683e-b54c-497a-9a5b-68329d7554ba', '54071a5c-a383-4453-843e-8b4e66494abc', 'd082160c-151f-4fe7-8e02-248f46d045a6', '7d63b1fa-6afb-423d-9360-2687bc182f70'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Flow 'volume_create_manager' (e5597da8-9c97-483e-9b5a-2a9edcf60201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08630a4-fda8-4ef4-bd46-7411259a563a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08630a4-fda8-4ef4-bd46-7411259a563a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1188693016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7accc945-97b3-4f30-99eb-64ed307ba5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10734b644b0d4f4bb3f426b6d8f07b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:42Z,use_quota=True,user_id='ed84d5922c264eeba3732a78d054dd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09cee7da-2919-45b1-87b7-6e5b873d5c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09cee7da-2919-45b1-87b7-6e5b873d5c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc36ecc0-9470-483d-959a-09d0bbe0923c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc36ecc0-9470-483d-959a-09d0bbe0923c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7accc945-97b3-4f30-99eb-64ed307ba5c2', 'volume_name': 'volume-7accc945-97b3-4f30-99eb-64ed307ba5c2', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f23c037-0512-45d4-9182-e2ea4180b9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f23c037-0512-45d4-9182-e2ea4180b9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08cf7295-b50b-415f-9b55-9715763acb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:42 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Volume 7accc945-97b3-4f30-99eb-64ed307ba5c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7accc945-97b3-4f30-99eb-64ed307ba5c2', 'volume_size': 1} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:42 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:37:42 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:42 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2 1073741824" returned: 0 in 0.568s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:42 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2 Sep 10 18:37:42 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Flow 'volume_create_manager' (d3d4c888-cf98-4113-96bf-a6af47644269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:42 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9155a0-db71-478a-a61d-ece7a58aece5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9155a0-db71-478a-a61d-ece7a58aece5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-922069138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf82166-6d4a-4430-9f88-622189529e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10734b644b0d4f4bb3f426b6d8f07b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:43Z,use_quota=True,user_id='ed84d5922c264eeba3732a78d054dd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72fedb1c-5377-4000-909c-b1e4c14041d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72fedb1c-5377-4000-909c-b1e4c14041d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ceb95f-f91e-4ba0-a01d-67191796b953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ceb95f-f91e-4ba0-a01d-67191796b953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bf82166-6d4a-4430-9f88-622189529e18', 'volume_name': 'volume-5bf82166-6d4a-4430-9f88-622189529e18', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c2afb0-0dcf-4e92-95e9-e32f593b31ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c2afb0-0dcf-4e92-95e9-e32f593b31ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f2323c-caa6-4048-bf76-3522e2b0bd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:43 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Volume 5bf82166-6d4a-4430-9f88-622189529e18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bf82166-6d4a-4430-9f88-622189529e18', 'volume_size': 1} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:43 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.390s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:37:43 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] Deleted volume successfully. Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0d6f8543-b404-4dd3-923e-54896e3ec42a tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-1ea5d6d6-f4a0-47c3-9409-5b739c59213b-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:43 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2" returned: 0 in 0.346s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.901s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1849241224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7ddca4-65bb-493e-8bdc-ea0be495162e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea0523a8abf4954b3193862f279db42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:39Z,use_quota=True,user_id='5ef024936a574a9d934c7694abb3cde3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Creating volume 2b7ddca4-65bb-493e-8bdc-ea0be495162e {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:43 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2b7ddca4-65bb-493e-8bdc-ea0be495162e 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f2157ee-e1a1-4f18-88e4-d535d511c51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe9b198-2c6b-4947-bdbf-8ffb1b764e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:43 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2b7ddca4-65bb-493e-8bdc-ea0be495162e 1073741824 Sep 10 18:37:43 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:43 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Volume volume-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2 (4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2): created successfully Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe9b198-2c6b-4947-bdbf-8ffb1b764e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Flow 'volume_create_manager' (0e7b8823-6bb2-4f1d-b4ad-a8b34218b11f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Flow 'volume_create_manager' (a435ba97-6240-46bd-b2d6-9cd355ff430f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d035b4-8dfc-409c-9e7e-a56bf1a18a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:43 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-48839573-c237-441c-a08d-d218c549a4a4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Created volume successfully. Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d035b4-8dfc-409c-9e7e-a56bf1a18a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-144910445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e180f00c-3861-4c3e-b0dc-0d8169b3af62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10734b644b0d4f4bb3f426b6d8f07b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:43Z,use_quota=True,user_id='ed84d5922c264eeba3732a78d054dd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89a12c6-ec5d-4355-acf1-be697509c3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89a12c6-ec5d-4355-acf1-be697509c3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25e7452-28f8-4e57-a201-f5f2b0d24787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25e7452-28f8-4e57-a201-f5f2b0d24787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e180f00c-3861-4c3e-b0dc-0d8169b3af62', 'volume_name': 'volume-e180f00c-3861-4c3e-b0dc-0d8169b3af62', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc4ee36-d6f3-4081-a692-3113aa2fb378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc4ee36-d6f3-4081-a692-3113aa2fb378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d0efd1-f387-4f1d-9d78-33aba1262c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:43 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Volume e180f00c-3861-4c3e-b0dc-0d8169b3af62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e180f00c-3861-4c3e-b0dc-0d8169b3af62', 'volume_size': 1} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Flow 'volume_create_manager' (a461b253-11d4-4447-8731-cc8ab9ce72b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4cee79-9e85-4e90-9e60-52217ac32ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4cee79-9e85-4e90-9e60-52217ac32ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1335682263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6c585a-5bdf-492d-be53-54374d4c5fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10734b644b0d4f4bb3f426b6d8f07b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:44Z,use_quota=True,user_id='ed84d5922c264eeba3732a78d054dd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cdda84-de9d-473e-8360-5803733135ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cdda84-de9d-473e-8360-5803733135ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee231e5-5b35-4a13-87cf-b09cb596e215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:43 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee231e5-5b35-4a13-87cf-b09cb596e215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d6c585a-5bdf-492d-be53-54374d4c5fdc', 'volume_name': 'volume-4d6c585a-5bdf-492d-be53-54374d4c5fdc', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231f0ce5-eade-45c0-9a56-826c87ce45a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231f0ce5-eade-45c0-9a56-826c87ce45a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82620f37-d866-4e67-bd7f-31d2d5273cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:43 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Volume 4d6c585a-5bdf-492d-be53-54374d4c5fdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d6c585a-5bdf-492d-be53-54374d4c5fdc', 'volume_size': 1} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2b7ddca4-65bb-493e-8bdc-ea0be495162e 1073741824" returned: 0 in 0.548s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "cinder-bc98947a-2784-4bf3-8527-74242f1b727b-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2b7ddca4-65bb-493e-8bdc-ea0be495162e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-bc98947a-2784-4bf3-8527-74242f1b727b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:43 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2b7ddca4-65bb-493e-8bdc-ea0be495162e Sep 10 18:37:43 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "cinder-quobyte-bc98947a-2784-4bf3-8527-74242f1b727b" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-quobyte-bc98947a-2784-4bf3-8527-74242f1b727b" acquired by "delete_volume" :: waited 0.028s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcc1fbf-ccde-4395-9a3e-e9c64f3f0480]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-bc98947a-2784-4bf3-8527-74242f1b727b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:44 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-bc98947a-2784-4bf3-8527-74242f1b727b Sep 10 18:37:44 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:44 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Flow 'volume_create_manager' (3ca138e0-7619-4782-9fe2-4b748d961764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997d3618-698c-4455-9cbb-2f3bc9cb0d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2b7ddca4-65bb-493e-8bdc-ea0be495162e" returned: 0 in 0.308s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.772s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00de4c53f5f8415199db055eec8a1cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:37Z,use_quota=True,user_id='c0006ae958b448db9d85d05502abbf4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b061888d-f2e3-461a-bba2-ed00740e516e),volume_type_id=b061888d-f2e3-461a-bba2-ed00740e516e)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Creating volume 85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:44 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997d3618-698c-4455-9cbb-2f3bc9cb0d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1424870984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e4e682-8f73-499a-b349-ecaf158547fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10734b644b0d4f4bb3f426b6d8f07b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:44Z,use_quota=True,user_id='ed84d5922c264eeba3732a78d054dd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:44 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 1073741824 Sep 10 18:37:44 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a5486d3-8716-4f0c-b030-da6803e7b64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a5486d3-8716-4f0c-b030-da6803e7b64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad3842c-45a8-40b2-9499-bf62163b7957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad3842c-45a8-40b2-9499-bf62163b7957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0e4e682-8f73-499a-b349-ecaf158547fb', 'volume_name': 'volume-f0e4e682-8f73-499a-b349-ecaf158547fb', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d34fb60-8e66-4bc5-9380-7d515caa2d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d34fb60-8e66-4bc5-9380-7d515caa2d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaec6b4b-ee20-476a-905b-34f2214f1e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:44 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Volume f0e4e682-8f73-499a-b349-ecaf158547fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0e4e682-8f73-499a-b349-ecaf158547fb', 'volume_size': 1} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30734415-b6fc-461c-ba1f-9ea94abcdbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b7ddca4-65bb-493e-8bdc-ea0be495162e', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2acb15fb-cd4a-44c9-b626-5987e8931536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:44 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Volume volume-2b7ddca4-65bb-493e-8bdc-ea0be495162e (2b7ddca4-65bb-493e-8bdc-ea0be495162e): created successfully Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2acb15fb-cd4a-44c9-b626-5987e8931536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Flow 'volume_create_manager' (39bd2b9c-deec-403b-bb64-d1debacc9368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:44 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-8141c1ce-8f10-4ba4-b0aa-759fc486249d tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Created volume successfully. Sep 10 18:37:44 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-bc98947a-2784-4bf3-8527-74242f1b727b" returned: 0 in 0.378s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-bc98947a-2784-4bf3-8527-74242f1b727b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:44 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-bc98947a-2784-4bf3-8527-74242f1b727b Sep 10 18:37:44 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:44 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 1073741824" returned: 0 in 0.457s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:44 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-bc98947a-2784-4bf3-8527-74242f1b727b" returned: 0 in 0.277s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-quobyte-bc98947a-2784-4bf3-8527-74242f1b727b" released by "delete_volume" :: held 0.710s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:44 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 Sep 10 18:37:44 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] Created reservations ['0f441e27-ad4b-46a7-9894-d6b43369e8aa', '88c3c2b3-323e-4a1b-9471-e73f4f9148f8', '834936ef-a4f3-4f58-a81e-b30c9c4b77e0', 'd432769b-3949-4070-a989-094176b76d74'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:44 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:37:44 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:44 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45" returned: 0 in 0.252s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.235s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2012288347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f06069-d402-489b-b049-e886c45941cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea0523a8abf4954b3193862f279db42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:40Z,use_quota=True,user_id='5ef024936a574a9d934c7694abb3cde3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Creating volume 29f06069-d402-489b-b049-e886c45941cc {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:44 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29f06069-d402-489b-b049-e886c45941cc 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:44 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29f06069-d402-489b-b049-e886c45941cc 1073741824 Sep 10 18:37:44 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:44 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Attempting download of b5355ec9-1a4a-4aae-bb5d-edc1c599eb80 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5355ec9-1a4a-4aae-bb5d-edc1c599eb80', 'metadata': {}}])) to volume 85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "cinder-c2794562-9c03-4c69-b306-8ada9d92756a-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-c2794562-9c03-4c69-b306-8ada9d92756a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:45 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1267d69d-56e9-4a32-ac13-b5b09b79c898]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_v_nh8w87 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.317s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "cinder-quobyte-c2794562-9c03-4c69-b306-8ada9d92756a" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:45 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] Deleted volume successfully. Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-quobyte-c2794562-9c03-4c69-b306-8ada9d92756a" acquired by "delete_volume" :: waited 0.039s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-47cf2f75-7657-4dc3-8d95-b40c0cbb8b85 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-bc98947a-2784-4bf3-8527-74242f1b727b-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91d0e4c-4d3f-416f-98eb-418820c1782c]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2794562-9c03-4c69-b306-8ada9d92756a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:45 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_v_nh8w87 Sep 10 18:37:45 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:45 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2794562-9c03-4c69-b306-8ada9d92756a Sep 10 18:37:45 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:45 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_v_nh8w87" returned: 0 in 0.373s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_v_nh8w87 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:45 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29f06069-d402-489b-b049-e886c45941cc 1073741824" returned: 0 in 0.580s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29f06069-d402-489b-b049-e886c45941cc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:45 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_v_nh8w87 Sep 10 18:37:45 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:45 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29f06069-d402-489b-b049-e886c45941cc Sep 10 18:37:45 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:45 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2794562-9c03-4c69-b306-8ada9d92756a" returned: 0 in 0.410s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2794562-9c03-4c69-b306-8ada9d92756a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:45 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2794562-9c03-4c69-b306-8ada9d92756a Sep 10 18:37:45 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:45 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_v_nh8w87" returned: 1 in 0.350s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_v_nh8w87' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:37:45 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83fba26-cc91-43cb-80ae-f69c2a843179]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29f06069-d402-489b-b049-e886c45941cc" returned: 0 in 0.247s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.772s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-6188024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0e3b40-d460-437d-b9ec-9cebd9dbe268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea0523a8abf4954b3193862f279db42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:40Z,use_quota=True,user_id='5ef024936a574a9d934c7694abb3cde3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Creating volume 2d0e3b40-d460-437d-b9ec-9cebd9dbe268 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:45 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2d0e3b40-d460-437d-b9ec-9cebd9dbe268 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:45 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2d0e3b40-d460-437d-b9ec-9cebd9dbe268 1073741824 Sep 10 18:37:45 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06e5896f-c956-4d24-a20f-6282b4d87671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f06069-d402-489b-b049-e886c45941cc', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fc0deb-3da2-4b99-abe7-677a67dc0eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:45 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-c2794562-9c03-4c69-b306-8ada9d92756a" returned: 0 in 0.265s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:45 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Volume volume-29f06069-d402-489b-b049-e886c45941cc (29f06069-d402-489b-b049-e886c45941cc): created successfully Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fc0deb-3da2-4b99-abe7-677a67dc0eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Flow 'volume_create_manager' (345486b4-5e06-494a-a6b8-17a3b390a4e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-quobyte-c2794562-9c03-4c69-b306-8ada9d92756a" released by "delete_volume" :: held 0.765s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:45 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-295a60cb-cd3c-4d45-9b37-c1f696ca793a tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Created volume successfully. Sep 10 18:37:45 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD Sep 10 18:37:45 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:45 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] Created reservations ['efba2f44-e22a-44ae-9977-10864d6bc788', '14c894c1-df09-4307-94e4-e38a5aea5abf', '2657b761-accc-4d37-b851-a590cf5bf1e2', 'cf69cb77-0546-4d05-b30b-de9fe5cf5e64'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:46 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:37:46 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "cinder-9e7e5aa4-e994-4bc6-9597-995130a3e54d-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-9e7e5aa4-e994-4bc6-9597-995130a3e54d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:46 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "cinder-quobyte-9e7e5aa4-e994-4bc6-9597-995130a3e54d" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-quobyte-9e7e5aa4-e994-4bc6-9597-995130a3e54d" acquired by "delete_volume" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:46 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.302s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e52d4b-fe79-41b3-a5d0-370910102f37]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9e7e5aa4-e994-4bc6-9597-995130a3e54d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:46 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] Deleted volume successfully. Sep 10 18:37:46 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2d0e3b40-d460-437d-b9ec-9cebd9dbe268 1073741824" returned: 0 in 0.563s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-85d43227-342d-4716-951a-9f6637180ac9 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-c2794562-9c03-4c69-b306-8ada9d92756a-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:46 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD Sep 10 18:37:46 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2d0e3b40-d460-437d-b9ec-9cebd9dbe268 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:46 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2d0e3b40-d460-437d-b9ec-9cebd9dbe268 Sep 10 18:37:46 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:46 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9e7e5aa4-e994-4bc6-9597-995130a3e54d Sep 10 18:37:46 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:46 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD" returned: 1 in 0.409s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] b5355ec9-1a4a-4aae-bb5d-edc1c599eb80 was raw, converting to qcow2 {{(pid=87842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:46 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 Sep 10 18:37:46 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:46 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2d0e3b40-d460-437d-b9ec-9cebd9dbe268" returned: 0 in 0.296s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.022s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1188693016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7accc945-97b3-4f30-99eb-64ed307ba5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10734b644b0d4f4bb3f426b6d8f07b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:42Z,use_quota=True,user_id='ed84d5922c264eeba3732a78d054dd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Creating volume 7accc945-97b3-4f30-99eb-64ed307ba5c2 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:46 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:46 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7accc945-97b3-4f30-99eb-64ed307ba5c2 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9e7e5aa4-e994-4bc6-9597-995130a3e54d" returned: 0 in 0.411s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9e7e5aa4-e994-4bc6-9597-995130a3e54d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:46 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7accc945-97b3-4f30-99eb-64ed307ba5c2 1073741824 Sep 10 18:37:46 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89362c4a-e7ce-4b07-9e89-fb5adf51b8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d0e3b40-d460-437d-b9ec-9cebd9dbe268', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a26ea21-b35d-4e34-b4a1-c9d5a6b41f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:46 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9e7e5aa4-e994-4bc6-9597-995130a3e54d Sep 10 18:37:46 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:46 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Volume volume-2d0e3b40-d460-437d-b9ec-9cebd9dbe268 (2d0e3b40-d460-437d-b9ec-9cebd9dbe268): created successfully Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a26ea21-b35d-4e34-b4a1-c9d5a6b41f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:46 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Flow 'volume_create_manager' (55e65c21-f09d-4a49-b0cb-be71f14b155e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:46 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-b0508a5f-55bc-489a-abee-44272c036814 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Created volume successfully. Sep 10 18:37:47 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9e7e5aa4-e994-4bc6-9597-995130a3e54d" returned: 0 in 0.272s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-quobyte-9e7e5aa4-e994-4bc6-9597-995130a3e54d" released by "delete_volume" :: held 0.725s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] Created reservations ['4b162929-3908-4010-ab9c-411b92a5b829', '420ce927-e6ca-40b6-a3e9-7b1da7c03420', '22961014-4202-4b8e-aeb6-723b45555a43', 'a92519b6-5340-47aa-bf7d-5cfe9e2c044c'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:47 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:37:47 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:47 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45" returned: 0 in 0.569s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5355ec9-1a4a-4aae-bb5d-edc1c599eb80_1k6v352gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:37:47 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:47 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7accc945-97b3-4f30-99eb-64ed307ba5c2 1073741824" returned: 0 in 0.512s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:47 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 1G Sep 10 18:37:47 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7accc945-97b3-4f30-99eb-64ed307ba5c2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:47 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7accc945-97b3-4f30-99eb-64ed307ba5c2 Sep 10 18:37:47 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:47 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.283s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:37:47 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] Deleted volume successfully. Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e77a1c05-0279-4af6-a59b-c15723aad2c6 tempest-CreateVolumesFromImageTest-1260983047 None] Lock "cinder-9e7e5aa4-e994-4bc6-9597-995130a3e54d-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:47 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 1G" returned: 0 in 0.387s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Downloaded image b5355ec9-1a4a-4aae-bb5d-edc1c599eb80 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5355ec9-1a4a-4aae-bb5d-edc1c599eb80', 'metadata': {}}])) to volume 85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 successfully. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Temporary image b5355ec9-1a4a-4aae-bb5d-edc1c599eb80 for user c0006ae958b448db9d85d05502abbf4b is deleted. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Marking volume 85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 as bootable. {{(pid=87842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Copying metadata from image b5355ec9-1a4a-4aae-bb5d-edc1c599eb80 to 85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45. {{(pid=87842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Creating volume glance metadata for volume 85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 backed by image b5355ec9-1a4a-4aae-bb5d-edc1c599eb80 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b5355ec9-1a4a-4aae-bb5d-edc1c599eb80', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '71f45c0ac0019871fab5d52b78ed687d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 18:37:47 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7accc945-97b3-4f30-99eb-64ed307ba5c2" returned: 0 in 0.369s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.620s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-922069138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf82166-6d4a-4430-9f88-622189529e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10734b644b0d4f4bb3f426b6d8f07b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:43Z,use_quota=True,user_id='ed84d5922c264eeba3732a78d054dd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Creating volume 5bf82166-6d4a-4430-9f88-622189529e18 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:47 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5bf82166-6d4a-4430-9f88-622189529e18 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:47 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5bf82166-6d4a-4430-9f88-622189529e18 1073741824 Sep 10 18:37:47 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08cf7295-b50b-415f-9b55-9715763acb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7accc945-97b3-4f30-99eb-64ed307ba5c2', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5559573a-0861-4843-b02b-18d861c92811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:47 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Volume volume-7accc945-97b3-4f30-99eb-64ed307ba5c2 (7accc945-97b3-4f30-99eb-64ed307ba5c2): created successfully Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5559573a-0861-4843-b02b-18d861c92811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Flow 'volume_create_manager' (e5597da8-9c97-483e-9b5a-2a9edcf60201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:47 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-33a4c930-3ddc-4662-9b56-79af570ca544 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Created volume successfully. Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "cinder-2d0e3b40-d460-437d-b9ec-9cebd9dbe268-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db393f31-d81e-4dac-acbc-e6fb27b26880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45', 'volume_size': 1, 'image_id': 'b5355ec9-1a4a-4aae-bb5d-edc1c599eb80', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5355ec9-1a4a-4aae-bb5d-edc1c599eb80', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71f45c0ac0019871fab5d52b78ed687d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '00de4c53f5f8415199db055eec8a1cc7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '66267fd6f3ca0997f457784319cf5d9f0c083ad0dd4a81236bbc5341a01555b4b9d167b1472b309f79ba55e40f59fc2f761d24af8b5d58d6e0b66d60bff8bb89', 'id': 'b5355ec9-1a4a-4aae-bb5d-edc1c599eb80', 'created_at': datetime.datetime(2026, 9, 10, 16, 37, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 37, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5355ec9-1a4a-4aae-bb5d-edc1c599eb80/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8c4857-0a2c-4243-aa62-4eefe966210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-2d0e3b40-d460-437d-b9ec-9cebd9dbe268-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:47 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Volume volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 (85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45): created successfully Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8c4857-0a2c-4243-aa62-4eefe966210f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Flow 'volume_create_manager' (19dc4843-d459-43a4-a038-90998ff41cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "cinder-quobyte-2d0e3b40-d460-437d-b9ec-9cebd9dbe268" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:47 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-334abffe-1ab5-4481-a1c8-2310ab262fa5 tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Created volume successfully. Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-quobyte-2d0e3b40-d460-437d-b9ec-9cebd9dbe268" acquired by "delete_volume" :: waited 0.032s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48503b2-f560-47ba-b162-71717b05dd83]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2d0e3b40-d460-437d-b9ec-9cebd9dbe268 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Acquiring lock "cinder-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Lock "cinder-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:48 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2d0e3b40-d460-437d-b9ec-9cebd9dbe268 Sep 10 18:37:48 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Acquiring lock "cinder-quobyte-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Lock "cinder-quobyte-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45" acquired by "delete_volume" :: waited 0.018s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2be16a-ef1a-422e-a1f1-770ac6d1d326]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:48 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5bf82166-6d4a-4430-9f88-622189529e18 1073741824" returned: 0 in 0.650s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5bf82166-6d4a-4430-9f88-622189529e18 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:48 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 Sep 10 18:37:48 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:48 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5bf82166-6d4a-4430-9f88-622189529e18 Sep 10 18:37:48 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:48 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2d0e3b40-d460-437d-b9ec-9cebd9dbe268" returned: 0 in 0.513s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2d0e3b40-d460-437d-b9ec-9cebd9dbe268 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:48 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2d0e3b40-d460-437d-b9ec-9cebd9dbe268 Sep 10 18:37:48 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:48 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5bf82166-6d4a-4430-9f88-622189529e18" returned: 0 in 0.313s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.304s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-144910445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e180f00c-3861-4c3e-b0dc-0d8169b3af62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10734b644b0d4f4bb3f426b6d8f07b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:43Z,use_quota=True,user_id='ed84d5922c264eeba3732a78d054dd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Creating volume e180f00c-3861-4c3e-b0dc-0d8169b3af62 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:48 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e180f00c-3861-4c3e-b0dc-0d8169b3af62 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:48 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45" returned: 0 in 0.538s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:48 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:48 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e180f00c-3861-4c3e-b0dc-0d8169b3af62 1073741824 Sep 10 18:37:48 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f2323c-caa6-4048-bf76-3522e2b0bd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf82166-6d4a-4430-9f88-622189529e18', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0163f736-18ff-4610-b76c-72a31fe7e29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:48 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45 Sep 10 18:37:48 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2d0e3b40-d460-437d-b9ec-9cebd9dbe268" returned: 0 in 0.321s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:48 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Volume volume-5bf82166-6d4a-4430-9f88-622189529e18 (5bf82166-6d4a-4430-9f88-622189529e18): created successfully Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0163f736-18ff-4610-b76c-72a31fe7e29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Flow 'volume_create_manager' (d3d4c888-cf98-4113-96bf-a6af47644269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-quobyte-2d0e3b40-d460-437d-b9ec-9cebd9dbe268" released by "delete_volume" :: held 0.908s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:48 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-2da466f9-0fd0-41e9-ab6f-2d91b53a9a4e tempest-CreateVolumesFromSnapshotTest-1833431004 None] Created volume successfully. Sep 10 18:37:48 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Created reservations ['04f59372-52ed-4348-a399-9b022ebbd2ac', 'b239e15b-ed4f-4553-9cbd-d0f90fbcf7c1', '3d7542d9-1766-4253-89b1-b717f2117b4f', 'be7425d2-8903-4917-9de6-671fdea3fb66'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "cinder-29f06069-d402-489b-b049-e886c45941cc-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:49 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:37:49 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-29f06069-d402-489b-b049-e886c45941cc-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:49 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45" returned: 0 in 0.379s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Lock "cinder-quobyte-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45" released by "delete_volume" :: held 0.996s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "cinder-quobyte-29f06069-d402-489b-b049-e886c45941cc" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-quobyte-29f06069-d402-489b-b049-e886c45941cc" acquired by "delete_volume" :: waited 0.031s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2ce4ad-d7d3-4fb0-88f6-9e267f18def5]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29f06069-d402-489b-b049-e886c45941cc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Created reservations ['21c35f98-0975-4712-a813-7b83a005c4d9', '41c10886-e43f-4b26-bb16-307a555424d4', '47eb9ef8-b092-4863-9a63-7d85e8e38558', '12114742-9e5c-4a2f-a3e1-44de9ff5f601'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:37:49 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:49 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.404s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e180f00c-3861-4c3e-b0dc-0d8169b3af62 1073741824" returned: 0 in 0.705s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:49 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29f06069-d402-489b-b049-e886c45941cc Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:37:49 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:49 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:37:49 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:49 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Deleted volume successfully. Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-57a8bc24-ae7c-49f0-b246-07c0866629f6 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-2d0e3b40-d460-437d-b9ec-9cebd9dbe268-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e180f00c-3861-4c3e-b0dc-0d8169b3af62 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:49 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e180f00c-3861-4c3e-b0dc-0d8169b3af62 Sep 10 18:37:49 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:49 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29f06069-d402-489b-b049-e886c45941cc" returned: 0 in 0.505s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29f06069-d402-489b-b049-e886c45941cc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:49 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.356s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:37:49 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29f06069-d402-489b-b049-e886c45941cc Sep 10 18:37:49 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:49 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Deleted volume successfully. Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-6ea62d90-298c-4749-9fc8-f19e911b943d tempest-VolumeAndVolumeTypeFromImageTest-1024998979 None] Lock "cinder-85a2bbba-e976-4fe7-abd9-6ebbbaf3fc45-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:49 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e180f00c-3861-4c3e-b0dc-0d8169b3af62" returned: 0 in 0.318s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.064s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1335682263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6c585a-5bdf-492d-be53-54374d4c5fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10734b644b0d4f4bb3f426b6d8f07b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:44Z,use_quota=True,user_id='ed84d5922c264eeba3732a78d054dd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Creating volume 4d6c585a-5bdf-492d-be53-54374d4c5fdc {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:49 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d6c585a-5bdf-492d-be53-54374d4c5fdc 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:49 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d6c585a-5bdf-492d-be53-54374d4c5fdc 1073741824 Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d0efd1-f387-4f1d-9d78-33aba1262c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e180f00c-3861-4c3e-b0dc-0d8169b3af62', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:49 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e387c539-d157-44e0-bb62-abae9b668e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:49 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Volume volume-e180f00c-3861-4c3e-b0dc-0d8169b3af62 (e180f00c-3861-4c3e-b0dc-0d8169b3af62): created successfully Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e387c539-d157-44e0-bb62-abae9b668e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Flow 'volume_create_manager' (a435ba97-6240-46bd-b2d6-9cd355ff430f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:49 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d69e452d-2b02-48ec-a805-a293bb348ecc tempest-CreateVolumesFromSnapshotTest-1833431004 None] Created volume successfully. Sep 10 18:37:50 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-29f06069-d402-489b-b049-e886c45941cc" returned: 0 in 0.274s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-quobyte-29f06069-d402-489b-b049-e886c45941cc" released by "delete_volume" :: held 0.824s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Created reservations ['c6e1c25c-d04b-44f1-878a-b385b428591e', 'bb9cc310-a243-49d7-a69a-da03480f1019', '57b3ed83-cbad-437f-a09a-4dcb598b8ece', '8350cd50-da20-4e19-9e07-00ba134ad04e'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:50 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:37:50 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "cinder-2b7ddca4-65bb-493e-8bdc-ea0be495162e-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-2b7ddca4-65bb-493e-8bdc-ea0be495162e-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:50 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d6c585a-5bdf-492d-be53-54374d4c5fdc 1073741824" returned: 0 in 0.677s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "cinder-quobyte-2b7ddca4-65bb-493e-8bdc-ea0be495162e" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-quobyte-2b7ddca4-65bb-493e-8bdc-ea0be495162e" acquired by "delete_volume" :: waited 0.027s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:50 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d210a9a7-aaad-4392-b2ac-d76c34cda5e4]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2b7ddca4-65bb-493e-8bdc-ea0be495162e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d6c585a-5bdf-492d-be53-54374d4c5fdc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.470s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:37:50 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Deleted volume successfully. Sep 10 18:37:50 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d6c585a-5bdf-492d-be53-54374d4c5fdc Sep 10 18:37:50 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4f157bad-992c-4bde-b7dd-ec49557653be tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-29f06069-d402-489b-b049-e886c45941cc-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:50 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2b7ddca4-65bb-493e-8bdc-ea0be495162e Sep 10 18:37:50 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:50 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d6c585a-5bdf-492d-be53-54374d4c5fdc" returned: 0 in 0.340s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.754s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1424870984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e4e682-8f73-499a-b349-ecaf158547fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10734b644b0d4f4bb3f426b6d8f07b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:44Z,use_quota=True,user_id='ed84d5922c264eeba3732a78d054dd23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Creating volume f0e4e682-8f73-499a-b349-ecaf158547fb {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:50 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0e4e682-8f73-499a-b349-ecaf158547fb 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:51 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0e4e682-8f73-499a-b349-ecaf158547fb 1073741824 Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82620f37-d866-4e67-bd7f-31d2d5273cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d6c585a-5bdf-492d-be53-54374d4c5fdc', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:51 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973b2b0f-53d2-4348-972d-e83268360c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:51 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2b7ddca4-65bb-493e-8bdc-ea0be495162e" returned: 0 in 0.450s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2b7ddca4-65bb-493e-8bdc-ea0be495162e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:51 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Volume volume-4d6c585a-5bdf-492d-be53-54374d4c5fdc (4d6c585a-5bdf-492d-be53-54374d4c5fdc): created successfully Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973b2b0f-53d2-4348-972d-e83268360c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:51 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2b7ddca4-65bb-493e-8bdc-ea0be495162e Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Flow 'volume_create_manager' (a461b253-11d4-4447-8731-cc8ab9ce72b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:51 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:51 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f9e4fd93-9b30-4bcc-af46-a66265d2287f tempest-CreateVolumesFromSnapshotTest-1833431004 None] Created volume successfully. Sep 10 18:37:51 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-2b7ddca4-65bb-493e-8bdc-ea0be495162e" returned: 0 in 0.423s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-quobyte-2b7ddca4-65bb-493e-8bdc-ea0be495162e" released by "delete_volume" :: held 0.944s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Created reservations ['96d77b94-7189-4585-a582-0f2c3ec49dae', '388ab2b8-941a-4f29-8382-1406491f11f5', '6aba700a-accb-42eb-ab16-4becef95cfc6', 'c6f463c2-995a-4e14-9ced-5661233e9576'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:37:51 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0e4e682-8f73-499a-b349-ecaf158547fb 1073741824" returned: 0 in 0.610s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0e4e682-8f73-499a-b349-ecaf158547fb {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:51 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0e4e682-8f73-499a-b349-ecaf158547fb Sep 10 18:37:51 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:51 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:37:51 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:51 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0e4e682-8f73-499a-b349-ecaf158547fb" returned: 0 in 0.280s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaec6b4b-ee20-476a-905b-34f2214f1e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0e4e682-8f73-499a-b349-ecaf158547fb', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1491d89-aae6-46ac-be80-ff2fda9f4d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:51 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Volume volume-f0e4e682-8f73-499a-b349-ecaf158547fb (f0e4e682-8f73-499a-b349-ecaf158547fb): created successfully Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1491d89-aae6-46ac-be80-ff2fda9f4d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Flow 'volume_create_manager' (3ca138e0-7619-4782-9fe2-4b748d961764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:52 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f7187cb5-1630-4f6b-83b2-0b6ae434c909 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Created volume successfully. Sep 10 18:37:52 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.353s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:37:52 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Deleted volume successfully. Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-21881e7c-d8dd-4f72-a7fb-b7ec75df1cf4 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-2b7ddca4-65bb-493e-8bdc-ea0be495162e-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Flow 'volume_create_manager' (398c5dd8-1a5d-4746-a406-1d9b93d9c469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d92a881-527c-44a9-a830-46e21f310ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d92a881-527c-44a9-a830-46e21f310ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65033549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d811529-3e3e-4c5c-a2d8-7baf7e8e016c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6ceb3234b46a4b8cb6b06de47d03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:53Z,use_quota=True,user_id='651651ec609e4eeda1eecd55281a7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088ac81c-e48e-44ea-8347-04c022191a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088ac81c-e48e-44ea-8347-04c022191a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2efc7d-68fe-4de5-82eb-3365fd5d7bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2efc7d-68fe-4de5-82eb-3365fd5d7bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d811529-3e3e-4c5c-a2d8-7baf7e8e016c', 'volume_name': 'volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12393f4-be60-423a-affa-a91fb2cfc5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12393f4-be60-423a-affa-a91fb2cfc5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf062064-d182-436f-a9bd-b21b5413b57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:52 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Volume 0d811529-3e3e-4c5c-a2d8-7baf7e8e016c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c', 'volume_size': 1} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65033549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d811529-3e3e-4c5c-a2d8-7baf7e8e016c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6ceb3234b46a4b8cb6b06de47d03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:53Z,use_quota=True,user_id='651651ec609e4eeda1eecd55281a7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Creating volume 0d811529-3e3e-4c5c-a2d8-7baf7e8e016c {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:52 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "cinder-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:52 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c 1073741824 Sep 10 18:37:52 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "cinder-quobyte-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-quobyte-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2" acquired by "delete_volume" :: waited 0.017s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00f936c-1cb9-4f05-b871-684753cbab2b]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:52 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2 Sep 10 18:37:52 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "cinder-f0e4e682-8f73-499a-b349-ecaf158547fb-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-f0e4e682-8f73-499a-b349-ecaf158547fb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "cinder-quobyte-f0e4e682-8f73-499a-b349-ecaf158547fb" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-quobyte-f0e4e682-8f73-499a-b349-ecaf158547fb" acquired by "delete_volume" :: waited 0.015s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c090988-fd66-4018-94d5-8e3b01cc0ce5]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0e4e682-8f73-499a-b349-ecaf158547fb {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:53 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c 1073741824" returned: 0 in 0.567s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:53 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2" returned: 0 in 0.460s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:53 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2 Sep 10 18:37:53 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:53 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c Sep 10 18:37:53 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:53 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0e4e682-8f73-499a-b349-ecaf158547fb Sep 10 18:37:53 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:53 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2" returned: 0 in 0.278s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-quobyte-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2" released by "delete_volume" :: held 0.795s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Created reservations ['0acc864f-9417-4112-983c-cf2dc3f61a9f', 'b333daa5-12ca-4a01-927f-2adeea668754', 'e2d94bd1-aafb-425e-88e2-cf157c0e875e', 'b54afaf6-5778-4d89-a915-40050a9ac0af'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:37:53 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c" returned: 0 in 0.346s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf062064-d182-436f-a9bd-b21b5413b57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b777c3-7d0d-46eb-b302-bd927ccb63ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:53 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Volume volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c (0d811529-3e3e-4c5c-a2d8-7baf7e8e016c): created successfully Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b777c3-7d0d-46eb-b302-bd927ccb63ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Flow 'volume_create_manager' (398c5dd8-1a5d-4746-a406-1d9b93d9c469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:53 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0e4e682-8f73-499a-b349-ecaf158547fb" returned: 0 in 0.498s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0e4e682-8f73-499a-b349-ecaf158547fb {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:53 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4ae0cbf3-8b2e-4bd8-af89-fe81149d039c tempest-ProjectMemberTests-1340142452 None] Created volume successfully. Sep 10 18:37:53 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0e4e682-8f73-499a-b349-ecaf158547fb Sep 10 18:37:53 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:53 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:37:53 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "cinder-cbb04109-8008-487f-80fe-8afc1ed7517c-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-cbb04109-8008-487f-80fe-8afc1ed7517c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "cinder-quobyte-cbb04109-8008-487f-80fe-8afc1ed7517c" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-quobyte-cbb04109-8008-487f-80fe-8afc1ed7517c" acquired by "delete_volume" :: waited 0.024s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:54 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f0e4e682-8f73-499a-b349-ecaf158547fb" returned: 0 in 0.301s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-quobyte-f0e4e682-8f73-499a-b349-ecaf158547fb" released by "delete_volume" :: held 0.841s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73d857c-7a67-4235-b231-80416d05caa2]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cbb04109-8008-487f-80fe-8afc1ed7517c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] Created reservations ['4196b7e2-90d2-49a3-bf90-3deda8c36829', '4b8636b9-6b8d-454f-b8f2-dc88f55e8fdd', 'b14f9286-2f9a-4fde-bcc6-39d892379fdf', '55200fb0-39d9-43b9-8e82-00a7d81887dc'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:37:54 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.353s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:37:54 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Deleted volume successfully. Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e9d7aa61-62f6-4345-8a8b-7cdd28305bb0 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-4a4fc332-1f0e-4d51-bbdc-9adfe85c3eb2-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:54 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cbb04109-8008-487f-80fe-8afc1ed7517c Sep 10 18:37:54 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:54 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:37:54 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "cinder-4d6c585a-5bdf-492d-be53-54374d4c5fdc-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-4d6c585a-5bdf-492d-be53-54374d4c5fdc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "cinder-quobyte-4d6c585a-5bdf-492d-be53-54374d4c5fdc" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-quobyte-4d6c585a-5bdf-492d-be53-54374d4c5fdc" acquired by "delete_volume" :: waited 0.017s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c79650-34b9-43f4-99ab-f054e949522d]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d6c585a-5bdf-492d-be53-54374d4c5fdc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:54 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.342s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:37:54 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] Deleted volume successfully. Sep 10 18:37:54 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cbb04109-8008-487f-80fe-8afc1ed7517c" returned: 0 in 0.538s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cbb04109-8008-487f-80fe-8afc1ed7517c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:54 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cbb04109-8008-487f-80fe-8afc1ed7517c Sep 10 18:37:54 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5ed3b700-93e3-4008-9e5a-9ba11f603fef tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-f0e4e682-8f73-499a-b349-ecaf158547fb-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:54 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d6c585a-5bdf-492d-be53-54374d4c5fdc Sep 10 18:37:54 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:54 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-cbb04109-8008-487f-80fe-8afc1ed7517c" returned: 0 in 0.308s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-quobyte-cbb04109-8008-487f-80fe-8afc1ed7517c" released by "delete_volume" :: held 0.899s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:54 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d6c585a-5bdf-492d-be53-54374d4c5fdc" returned: 0 in 0.480s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d6c585a-5bdf-492d-be53-54374d4c5fdc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:55 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d6c585a-5bdf-492d-be53-54374d4c5fdc Sep 10 18:37:55 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Created reservations ['e50f6fab-87e3-436c-a1b7-2cc4e6791950', 'fe115749-1180-4563-8053-49cd3040412f', '8ce13e35-eb5f-4afd-a7b5-52de3d851e5e', '38ff742a-1d21-4da0-80f6-64a5a8cd85cb'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:55 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:37:55 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:55 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d6c585a-5bdf-492d-be53-54374d4c5fdc" returned: 0 in 0.297s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-quobyte-4d6c585a-5bdf-492d-be53-54374d4c5fdc" released by "delete_volume" :: held 0.868s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "cinder-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-928a95c0-4eff-4a93-80bd-e40ab8d2e004 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-928a95c0-4eff-4a93-80bd-e40ab8d2e004 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-928a95c0-4eff-4a93-80bd-e40ab8d2e004 tempest-ProjectMemberTests-1340142452 None] Creating offline snapshot 0cc9e7a0-e55f-4732-bcf4-397fcea17021 of volume 0d811529-3e3e-4c5c-a2d8-7baf7e8e016c {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d3dc2b-6676-43e6-960c-138580ca13ea]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-928a95c0-4eff-4a93-80bd-e40ab8d2e004 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:55 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.439s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:37:55 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Deleted volume successfully. Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "cinder-quobyte-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Created reservations ['691b6b5b-4589-463f-a72f-a15b3936093f', '489d68a0-5e59-4efa-9269-b563a110eb15', 'cd77447d-315f-4816-8223-3efafecf51c8', 'bda55d87-b22d-4e6a-87fd-9c9c46c00ec0'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3ce7d953-fd58-415f-8c04-aaa527303b97 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-cbb04109-8008-487f-80fe-8afc1ed7517c-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-quobyte-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d" acquired by "delete_volume" :: waited 0.036s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b22576b-e680-40e8-b2f7-4f3911938c94]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:55 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c Sep 10 18:37:55 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:55 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:37:55 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Flow 'volume_create_manager' (f583de04-183c-477f-b514-b68a4c38599d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:55 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d Sep 10 18:37:55 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e389af-8a60-45b2-b302-ae2d19453de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e389af-8a60-45b2-b302-ae2d19453de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1927153800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d695306-5105-438f-906f-3c2a5c527b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='856053643b4a4d0eb18f0538addae56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:56Z,use_quota=True,user_id='da760636501d4eb1886d20dbd066d314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36238de3-ebec-47c4-ae22-69819f0cd7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36238de3-ebec-47c4-ae22-69819f0cd7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f0858d-9fc7-413e-b434-24aa4bc7911c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f0858d-9fc7-413e-b434-24aa4bc7911c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d695306-5105-438f-906f-3c2a5c527b03', 'volume_name': 'volume-4d695306-5105-438f-906f-3c2a5c527b03', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a448fa2-a1b0-4ff5-ad8b-14ebc09d7d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a448fa2-a1b0-4ff5-ad8b-14ebc09d7d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ccbe65-6aee-4082-bebe-48b1dea7b4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:55 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Volume 4d695306-5105-438f-906f-3c2a5c527b03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d695306-5105-438f-906f-3c2a5c527b03', 'volume_size': 1} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:55 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-928a95c0-4eff-4a93-80bd-e40ab8d2e004 tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c" returned: 0 in 0.488s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-928a95c0-4eff-4a93-80bd-e40ab8d2e004 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:55 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021 1G Sep 10 18:37:56 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:56 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.307s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:37:56 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Deleted volume successfully. Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-be85893e-249c-4f3c-b8f3-0e3420e02cc0 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-4d6c585a-5bdf-492d-be53-54374d4c5fdc-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:56 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d" returned: 0 in 0.402s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:56 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d Sep 10 18:37:56 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:56 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d" returned: 0 in 0.297s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-quobyte-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d" released by "delete_volume" :: held 0.755s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:56 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-928a95c0-4eff-4a93-80bd-e40ab8d2e004 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021 1G" returned: 0 in 0.438s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-928a95c0-4eff-4a93-80bd-e40ab8d2e004 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:56 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021 Sep 10 18:37:56 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Created reservations ['59397169-67a0-49c9-ae61-4446b2f67846', '5af67c42-2743-4dcf-a457-c80691a4af84', '16cd52a9-684f-4347-b6f9-e14d90ecf3c1', '9fe2e1fd-e43c-4456-ac30-27898be9591d'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:56 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:37:56 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "cinder-e180f00c-3861-4c3e-b0dc-0d8169b3af62-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:56 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-e180f00c-3861-4c3e-b0dc-0d8169b3af62-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-928a95c0-4eff-4a93-80bd-e40ab8d2e004 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021" returned: 0 in 0.335s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:56 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-928a95c0-4eff-4a93-80bd-e40ab8d2e004 tempest-ProjectMemberTests-1340142452 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021 is being set with open permissions: ugo+rw Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-928a95c0-4eff-4a93-80bd-e40ab8d2e004 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:56 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021 Sep 10 18:37:56 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "cinder-quobyte-e180f00c-3861-4c3e-b0dc-0d8169b3af62" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-quobyte-e180f00c-3861-4c3e-b0dc-0d8169b3af62" acquired by "delete_volume" :: waited 0.018s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb556848-7ea0-420b-8235-81c9572f5252]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e180f00c-3861-4c3e-b0dc-0d8169b3af62 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:56 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.276s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:37:56 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Deleted volume successfully. Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9517f23c-044b-4fb8-a6f9-ea88c6cf6343 tempest-CreateVolumesFromSourceVolumeTest-1558119297 None] Lock "cinder-5eaefdaf-580a-4fd2-8372-95cc4a6fc88d-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:56 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e180f00c-3861-4c3e-b0dc-0d8169b3af62 Sep 10 18:37:56 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:56 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-928a95c0-4eff-4a93-80bd-e40ab8d2e004 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021" returned: 0 in 0.256s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-928a95c0-4eff-4a93-80bd-e40ab8d2e004 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:57 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.info Sep 10 18:37:57 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:57 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e180f00c-3861-4c3e-b0dc-0d8169b3af62" returned: 0 in 0.387s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e180f00c-3861-4c3e-b0dc-0d8169b3af62 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:57 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e180f00c-3861-4c3e-b0dc-0d8169b3af62 Sep 10 18:37:57 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:57 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-928a95c0-4eff-4a93-80bd-e40ab8d2e004 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.info" returned: 0 in 0.265s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:57 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-928a95c0-4eff-4a93-80bd-e40ab8d2e004 tempest-ProjectMemberTests-1340142452 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.info is being set with open permissions: ugo+rw Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-928a95c0-4eff-4a93-80bd-e40ab8d2e004 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:57 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.info Sep 10 18:37:57 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:57 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e180f00c-3861-4c3e-b0dc-0d8169b3af62" returned: 0 in 0.256s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-quobyte-e180f00c-3861-4c3e-b0dc-0d8169b3af62" released by "delete_volume" :: held 0.683s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Created reservations ['6ea5539f-6213-421e-a336-0b8cffcfa673', '268c9a33-47b7-418f-968f-63243e8b6305', 'd4697002-5199-4bd0-b859-24bc98118cd2', 'd1f1bb5c-9701-4f2d-b561-6b60cdf77a40'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:37:57 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-928a95c0-4eff-4a93-80bd-e40ab8d2e004 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.info" returned: 0 in 0.269s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-928a95c0-4eff-4a93-80bd-e40ab8d2e004 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.736s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1927153800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d695306-5105-438f-906f-3c2a5c527b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='856053643b4a4d0eb18f0538addae56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:37:56Z,use_quota=True,user_id='da760636501d4eb1886d20dbd066d314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Creating volume 4d695306-5105-438f-906f-3c2a5c527b03 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:37:57 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:57 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03 1073741824 Sep 10 18:37:57 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:57 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-928a95c0-4eff-4a93-80bd-e40ab8d2e004 tempest-ProjectMemberTests-1340142452 None] Create snapshot completed successfully Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:57 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:37:57 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "cinder-5bf82166-6d4a-4430-9f88-622189529e18-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-5bf82166-6d4a-4430-9f88-622189529e18-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:57 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.287s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:37:57 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Deleted volume successfully. Sep 10 18:37:57 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "cinder-quobyte-5bf82166-6d4a-4430-9f88-622189529e18" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-ec1c39d3-cd9e-4da3-906b-5862817f8a27 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-e180f00c-3861-4c3e-b0dc-0d8169b3af62-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-quobyte-5bf82166-6d4a-4430-9f88-622189529e18" acquired by "delete_volume" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaddebb7-52bc-4517-a988-9d895bab2248]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5bf82166-6d4a-4430-9f88-622189529e18 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03 1073741824" returned: 0 in 0.583s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:58 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:58 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5bf82166-6d4a-4430-9f88-622189529e18 Sep 10 18:37:58 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:58 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03 Sep 10 18:37:58 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:58 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03" returned: 0 in 0.321s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-0cc9e7a0-e55f-4732-bcf4-397fcea17021-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-0cc9e7a0-e55f-4732-bcf4-397fcea17021-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:58 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ccbe65-6aee-4082-bebe-48b1dea7b4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d695306-5105-438f-906f-3c2a5c527b03', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b870949f-9ba5-44eb-aae4-b63916ebec0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5bf82166-6d4a-4430-9f88-622189529e18" returned: 0 in 0.598s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5bf82166-6d4a-4430-9f88-622189529e18 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-0cc9e7a0-e55f-4732-bcf4-397fcea17021" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:37:58 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Volume volume-4d695306-5105-438f-906f-3c2a5c527b03 (4d695306-5105-438f-906f-3c2a5c527b03): created successfully Sep 10 18:37:58 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5bf82166-6d4a-4430-9f88-622189529e18 Sep 10 18:37:58 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b870949f-9ba5-44eb-aae4-b63916ebec0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Flow 'volume_create_manager' (f583de04-183c-477f-b514-b68a4c38599d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-0cc9e7a0-e55f-4732-bcf4-397fcea17021" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] Deleting offline snapshot 0cc9e7a0-e55f-4732-bcf4-397fcea17021 of volume 0d811529-3e3e-4c5c-a2d8-7baf7e8e016c {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] snapshot_file for this snap is: volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:37:58 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-fa5c97b8-db01-4f8f-9fe7-e9ad4962800f tempest-VolumeDependencyTests-847876440 None] Created volume successfully. Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[31889068-847e-4556-9d0a-67ac31487222]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:58 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021 Sep 10 18:37:58 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:58 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5bf82166-6d4a-4430-9f88-622189529e18" returned: 0 in 0.273s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-quobyte-5bf82166-6d4a-4430-9f88-622189529e18" released by "delete_volume" :: held 0.922s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Created reservations ['4f17bd7a-4149-4125-8b45-676daa552ec6', '43f3b50f-759f-442d-b08e-d4a5b1f05050', 'eca26336-ced1-4b74-b24b-b0c1ff06bb45', '36e739f1-ce29-4c1b-9d2a-eef789e0de29'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7f5b8ff6-aff8-48d1-9d07-d453857a8705 tempest-VolumeDependencyTests-847876440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7f5b8ff6-aff8-48d1-9d07-d453857a8705 tempest-VolumeDependencyTests-847876440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-7f5b8ff6-aff8-48d1-9d07-d453857a8705 tempest-VolumeDependencyTests-847876440 None] Creating offline snapshot 5650d4cd-75ff-4f18-bc48-0f2e4931449a of volume 4d695306-5105-438f-906f-3c2a5c527b03 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bd0380-1331-4cc3-b867-229c1a96bbd9]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5b8ff6-aff8-48d1-9d07-d453857a8705 tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:59 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:37:59 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:59 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021" returned: 0 in 0.511s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b90a6ef-97ff-4fea-98bd-f43959114a3d]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:59 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03 Sep 10 18:37:59 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:59 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c Sep 10 18:37:59 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:59 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.345s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:37:59 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Deleted volume successfully. Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2736252e-8e5e-41b8-8651-c1270d5c4ec5 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-5bf82166-6d4a-4430-9f88-622189529e18-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:37:59 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5b8ff6-aff8-48d1-9d07-d453857a8705 tempest-VolumeDependencyTests-847876440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03" returned: 0 in 0.519s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5b8ff6-aff8-48d1-9d07-d453857a8705 tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:59 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a 1G Sep 10 18:37:59 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:37:59 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c" returned: 0 in 0.457s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:37:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:37:59 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021 Sep 10 18:37:59 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:00 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021" returned: 0 in 0.382s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:00 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5b8ff6-aff8-48d1-9d07-d453857a8705 tempest-VolumeDependencyTests-847876440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a 1G" returned: 0 in 0.462s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5b8ff6-aff8-48d1-9d07-d453857a8705 tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d695306-5105-438f-906f-3c2a5c527b03 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:00 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021 Sep 10 18:38:00 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:00 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d695306-5105-438f-906f-3c2a5c527b03 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a Sep 10 18:38:00 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "cinder-7accc945-97b3-4f30-99eb-64ed307ba5c2-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-7accc945-97b3-4f30-99eb-64ed307ba5c2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "cinder-quobyte-7accc945-97b3-4f30-99eb-64ed307ba5c2" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-quobyte-7accc945-97b3-4f30-99eb-64ed307ba5c2" acquired by "delete_volume" :: waited 0.017s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49c4158-f767-418d-b641-7d5313c44646]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7accc945-97b3-4f30-99eb-64ed307ba5c2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:00 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7accc945-97b3-4f30-99eb-64ed307ba5c2 Sep 10 18:38:00 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:00 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c.0cc9e7a0-e55f-4732-bcf4-397fcea17021" returned: 0 in 0.352s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:00 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-0cc9e7a0-e55f-4732-bcf4-397fcea17021" released by "_delete_snapshot" :: held 1.846s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5b8ff6-aff8-48d1-9d07-d453857a8705 tempest-VolumeDependencyTests-847876440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d695306-5105-438f-906f-3c2a5c527b03 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a" returned: 0 in 0.393s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:00 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-7f5b8ff6-aff8-48d1-9d07-d453857a8705 tempest-VolumeDependencyTests-847876440 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a is being set with open permissions: ugo+rw Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5b8ff6-aff8-48d1-9d07-d453857a8705 tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c" released by "delete_snapshot" :: held 1.918s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:00 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a Sep 10 18:38:00 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] Created reservations ['30d3b6fc-fe36-4393-8366-488a8510618b', '63d6fd02-f568-4097-8afe-115c6efeeb53', 'b7ce5050-3706-4c40-90f3-7ad305682aa6', 'c603eb49-2bd9-42b9-a381-bf50e34a4306'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:00 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] Delete snapshot completed successfully. Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-79a88ee9-b52a-4489-a089-c522dd18e214 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-0cc9e7a0-e55f-4732-bcf4-397fcea17021-delete_snapshot" released by "delete_snapshot" :: held 2.149s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:00 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7accc945-97b3-4f30-99eb-64ed307ba5c2" returned: 0 in 0.469s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7accc945-97b3-4f30-99eb-64ed307ba5c2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:00 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7accc945-97b3-4f30-99eb-64ed307ba5c2 Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:00 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:00 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5b8ff6-aff8-48d1-9d07-d453857a8705 tempest-VolumeDependencyTests-847876440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a" returned: 0 in 0.344s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c" acquired by "delete_volume" :: waited 0.024s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5b8ff6-aff8-48d1-9d07-d453857a8705 tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecadab6-e711-43db-a0e9-347b8f0e866b]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:01 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.info Sep 10 18:38:01 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:01 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c Sep 10 18:38:01 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:01 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-7accc945-97b3-4f30-99eb-64ed307ba5c2" returned: 0 in 0.357s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-quobyte-7accc945-97b3-4f30-99eb-64ed307ba5c2" released by "delete_volume" :: held 0.890s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Created reservations ['c262fe2d-32b3-4e48-8b9b-dda32b967b34', '8df0b649-93e2-4487-a6e3-7fc17429dc29', '7e96ce84-23ac-44f8-ad09-522a5dec00ef', 'c9abb5a0-2fc6-4ba0-92cd-cbf48afaae7a'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:01 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5b8ff6-aff8-48d1-9d07-d453857a8705 tempest-VolumeDependencyTests-847876440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.info" returned: 0 in 0.427s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:01 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-7f5b8ff6-aff8-48d1-9d07-d453857a8705 tempest-VolumeDependencyTests-847876440 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.info is being set with open permissions: ugo+rw Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5b8ff6-aff8-48d1-9d07-d453857a8705 tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:01 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.info Sep 10 18:38:01 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:01 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:01 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "cinder-a2876934-664a-4898-a656-539a7d76e687-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-a2876934-664a-4898-a656-539a7d76e687-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "cinder-quobyte-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:01 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c" returned: 0 in 0.584s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-quobyte-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "cinder-quobyte-a2876934-664a-4898-a656-539a7d76e687" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-quobyte-a2876934-664a-4898-a656-539a7d76e687" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] Deleting offline snapshot a2876934-664a-4898-a656-539a7d76e687 of volume 188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:38:01 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c Sep 10 18:38:01 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] snapshot_file for this snap is: volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb336c1-0883-4129-b7f3-301fd5e8f2f5]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:01 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7f5b8ff6-aff8-48d1-9d07-d453857a8705 tempest-VolumeDependencyTests-847876440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.info" returned: 0 in 0.337s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7f5b8ff6-aff8-48d1-9d07-d453857a8705 tempest-VolumeDependencyTests-847876440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.655s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Flow 'volume_create_manager' (7aa1ffcf-bdfc-4fc0-86dd-ab858432ac71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90385be-ace2-42b8-a42b-095fe2be1e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:01 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687 Sep 10 18:38:01 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:01 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90385be-ace2-42b8-a42b-095fe2be1e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1873b4-c33a-4cfc-9f6d-3e8913c39555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71593563d3364f8588e871418208ef5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:02Z,use_quota=True,user_id='c6187dd4b31e42058e2ad7596b1c0f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87151ce2-1f4f-423e-a122-82a044457946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87151ce2-1f4f-423e-a122-82a044457946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edf9c14-d7ac-47ec-92aa-dc6e74fc4e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edf9c14-d7ac-47ec-92aa-dc6e74fc4e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b1873b4-c33a-4cfc-9f6d-3e8913c39555', 'volume_name': 'volume-4b1873b4-c33a-4cfc-9f6d-3e8913c39555', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebaa278-d723-4fc8-a0aa-4053dd92e567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebaa278-d723-4fc8-a0aa-4053dd92e567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce94c862-3fc2-49f2-b874-5386d7767a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:01 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Volume 4b1873b4-c33a-4cfc-9f6d-3e8913c39555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b1873b4-c33a-4cfc-9f6d-3e8913c39555', 'volume_size': 1} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1873b4-c33a-4cfc-9f6d-3e8913c39555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71593563d3364f8588e871418208ef5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:02Z,use_quota=True,user_id='c6187dd4b31e42058e2ad7596b1c0f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Creating volume 4b1873b4-c33a-4cfc-9f6d-3e8913c39555 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:38:01 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b1873b4-c33a-4cfc-9f6d-3e8913c39555 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:01 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-7f5b8ff6-aff8-48d1-9d07-d453857a8705 tempest-VolumeDependencyTests-847876440 None] Create snapshot completed successfully Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.454s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:01 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:01 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Deleted volume successfully. Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c" returned: 0 in 0.340s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:01 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b1873b4-c33a-4cfc-9f6d-3e8913c39555 1073741824 Sep 10 18:38:01 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c" released by "delete_volume" :: held 1.016s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-612cbdc9-1892-4044-9205-3474302d2296 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-7accc945-97b3-4f30-99eb-64ed307ba5c2-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] Created reservations ['2ccc385e-8047-4761-a17e-cad5f2e5d686', 'af5dcd16-25eb-4ff4-b364-611c7e1e2fd6', '7b95215c-feaa-4cb0-90c9-d60db579a1eb', '7645b776-5216-467f-8d1a-930f7e1eaef3'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:02 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:02 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:02 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687" returned: 0 in 0.458s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa432d0-053a-4e95-969c-45294412f863]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:02 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 Sep 10 18:38:02 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:02 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.257s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:02 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] Deleted volume successfully. Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-51ccb092-7a73-4ce0-abce-c63e551f3ab8 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-0d811529-3e3e-4c5c-a2d8-7baf7e8e016c-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:02 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b1873b4-c33a-4cfc-9f6d-3e8913c39555 1073741824" returned: 0 in 0.553s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b1873b4-c33a-4cfc-9f6d-3e8913c39555 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:02 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b1873b4-c33a-4cfc-9f6d-3e8913c39555 Sep 10 18:38:02 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:02 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0" returned: 0 in 0.432s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:02 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687 Sep 10 18:38:02 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:02 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b1873b4-c33a-4cfc-9f6d-3e8913c39555" returned: 0 in 0.276s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce94c862-3fc2-49f2-b874-5386d7767a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b1873b4-c33a-4cfc-9f6d-3e8913c39555', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5947d61a-31ed-417c-81f4-ab889e953601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:02 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Volume volume-4b1873b4-c33a-4cfc-9f6d-3e8913c39555 (4b1873b4-c33a-4cfc-9f6d-3e8913c39555): created successfully Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5947d61a-31ed-417c-81f4-ab889e953601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Flow 'volume_create_manager' (7aa1ffcf-bdfc-4fc0-86dd-ab858432ac71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:02 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-248764cb-ed9c-4a76-9b0a-b57c9a38976f tempest-CinderUnicodeTest-633965965 None] Created volume successfully. Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Flow 'volume_create_manager' (a54d5a3a-883e-4437-8c39-7e80ecdfefc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77341c8-705c-4a96-b938-920bf242f512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77341c8-705c-4a96-b938-920bf242f512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-564573233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8360194d-cb97-45fb-a1f7-392eeba7dbea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='856053643b4a4d0eb18f0538addae56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5650d4cd-75ff-4f18-bc48-0f2e4931449a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:03Z,use_quota=True,user_id='da760636501d4eb1886d20dbd066d314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2251e95a-e522-40e3-ad65-420c136209d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2251e95a-e522-40e3-ad65-420c136209d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01953b4-ac74-4c4f-acd5-530fc85a2f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01953b4-ac74-4c4f-acd5-530fc85a2f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8360194d-cb97-45fb-a1f7-392eeba7dbea', 'volume_name': 'volume-8360194d-cb97-45fb-a1f7-392eeba7dbea', 'volume_size': 1, 'snapshot_id': '5650d4cd-75ff-4f18-bc48-0f2e4931449a'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cfa6369-f0a1-4a07-afdf-0319ad71692f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cfa6369-f0a1-4a07-afdf-0319ad71692f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0223994-722f-4efc-88fc-1947c6daa3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:02 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Volume 8360194d-cb97-45fb-a1f7-392eeba7dbea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8360194d-cb97-45fb-a1f7-392eeba7dbea', 'volume_size': 1, 'snapshot_id': '5650d4cd-75ff-4f18-bc48-0f2e4931449a'} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Acquiring lock "cinder-quobyte-5650d4cd-75ff-4f18-bc48-0f2e4931449a-8360194d-cb97-45fb-a1f7-392eeba7dbea" by "_create_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Lock "cinder-quobyte-5650d4cd-75ff-4f18-bc48-0f2e4931449a-8360194d-cb97-45fb-a1f7-392eeba7dbea" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Creating volume 8360194d-cb97-45fb-a1f7-392eeba7dbea from snapshot 5650d4cd-75ff-4f18-bc48-0f2e4931449a {{(pid=87842) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Acquiring lock "cinder-quobyte-8360194d-cb97-45fb-a1f7-392eeba7dbea" by "_copy_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:02 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Lock "cinder-quobyte-8360194d-cb97-45fb-a1f7-392eeba7dbea" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] snapshot: 5650d4cd-75ff-4f18-bc48-0f2e4931449a, volume: 8360194d-cb97-45fb-a1f7-392eeba7dbea, {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687" returned: 0 in 0.390s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:03 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687 Sep 10 18:38:03 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd049728-6a71-4a84-8d64-eed6f706fede]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:03 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a Sep 10 18:38:03 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:03 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0.a2876934-664a-4898-a656-539a7d76e687" returned: 0 in 0.273s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-quobyte-a2876934-664a-4898-a656-539a7d76e687" released by "_delete_snapshot" :: held 1.697s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-quobyte-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0" released by "delete_snapshot" :: held 1.732s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] Created reservations ['a6e7ee8c-64b8-4e33-8a1b-39b7b746bf37', '26693b0e-5111-4341-8432-34e64ee9acb5', '743debd5-a9b2-4a71-ba63-42a89b4ebcf8', 'e3f981ed-4a40-45b0-a102-cf3dbc5fa9c9'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:03 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] Delete snapshot completed successfully. Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c21c60c9-6ef9-4f06-9e9c-6904f7f762ed tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-a2876934-664a-4898-a656-539a7d76e687-delete_snapshot" released by "delete_snapshot" :: held 1.941s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:03 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a" returned: 0 in 0.457s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d695306-5105-438f-906f-3c2a5c527b03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb6aaa9-798c-4937-aace-354e1b4818b1]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Flow 'volume_create_manager' (6d0fee6d-5984-45db-8031-f3b6fe407244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e9bfdf-2381-4fee-8e2d-12f3efd170f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:03 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03 Sep 10 18:38:03 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e9bfdf-2381-4fee-8e2d-12f3efd170f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892535401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3047c7-3e63-46fd-a6a4-db93fdfb424b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6ceb3234b46a4b8cb6b06de47d03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:04Z,use_quota=True,user_id='651651ec609e4eeda1eecd55281a7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1441ff11-e9a8-42c6-acb3-64618279b3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1441ff11-e9a8-42c6-acb3-64618279b3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2031c95b-bde9-43b9-9ddd-8ebb1d3a7754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2031c95b-bde9-43b9-9ddd-8ebb1d3a7754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a3047c7-3e63-46fd-a6a4-db93fdfb424b', 'volume_name': 'volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300662ec-e584-4928-955f-5767fd091ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300662ec-e584-4928-955f-5767fd091ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e175a7-aee6-4adb-98dd-d3c357e1bea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:03 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Volume 5a3047c7-3e63-46fd-a6a4-db93fdfb424b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b', 'volume_size': 1} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "cinder-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "cinder-quobyte-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-quobyte-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0" acquired by "delete_volume" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d52bd62-ca4a-4786-8c30-7a2de4f2bb89]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:03 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 Sep 10 18:38:03 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:04 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03" returned: 0 in 0.466s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03 {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Creating direct copy from snapshot {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG cinder.utils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Path /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8360194d-cb97-45fb-a1f7-392eeba7dbea not found in is_blk_device check {{(pid=87842) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8360194d-cb97-45fb-a1f7-392eeba7dbea {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:04 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8360194d-cb97-45fb-a1f7-392eeba7dbea Sep 10 18:38:04 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Flow 'volume_create_manager' (630f7018-2c8c-4e6d-90c0-2a5c96736fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f0978c-b580-4885-8840-226f7da0705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:04 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f0978c-b580-4885-8840-226f7da0705f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-284051952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f684556-fbac-4112-bb17-5d5040918d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71593563d3364f8588e871418208ef5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:04Z,use_quota=True,user_id='c6187dd4b31e42058e2ad7596b1c0f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23930d36-b7e0-48f6-ae1d-60b2872ebd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23930d36-b7e0-48f6-ae1d-60b2872ebd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c504c03-9536-4578-a7bf-12d30b2193ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c504c03-9536-4578-a7bf-12d30b2193ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f684556-fbac-4112-bb17-5d5040918d80', 'volume_name': 'volume-6f684556-fbac-4112-bb17-5d5040918d80', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb81c1f-5c8f-4288-a6e8-61a53b80bb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb81c1f-5c8f-4288-a6e8-61a53b80bb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28bf304a-3877-430e-b361-27e8f0c81418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:04 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Volume 6f684556-fbac-4112-bb17-5d5040918d80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f684556-fbac-4112-bb17-5d5040918d80', 'volume_size': 1} Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0" returned: 0 in 0.488s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:04 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0 Sep 10 18:38:04 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:04 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0" returned: 0 in 0.558s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-quobyte-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0" released by "delete_volume" :: held 1.149s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:05 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Created reservations ['5b12a5b8-6b16-4907-af32-c919924ab464', '30b3bd79-f041-42fb-b94e-3a2e765ac2d1', '12ab529b-bc9d-43fd-8233-670973a68203', 'a6bdbf76-bf76-430f-a8f2-32acbf84536a'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:05 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:05 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:05 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.424s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:05 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:05 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Deleted volume successfully. Sep 10 18:38:05 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-7ef6b00b-6f4d-4220-9a74-d5638a2bdf09 tempest-CreateVolumesFromSnapshotTest-1833431004 None] Lock "cinder-188b2f6f-6a0b-4f04-a261-75a0bf9f34f0-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:08 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8360194d-cb97-45fb-a1f7-392eeba7dbea" returned: 0 in 4.785s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:08 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Image conversion details: src /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03, size 1024.00 MB, duration 4.79 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8360194d-cb97-45fb-a1f7-392eeba7dbea {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:38:08 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Converted 1024.00 MB image at 213.94 MB/s Sep 10 18:38:08 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8360194d-cb97-45fb-a1f7-392eeba7dbea is being set with open permissions: ugo+rw Sep 10 18:38:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8360194d-cb97-45fb-a1f7-392eeba7dbea {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:08 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8360194d-cb97-45fb-a1f7-392eeba7dbea Sep 10 18:38:08 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:09 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8360194d-cb97-45fb-a1f7-392eeba7dbea" returned: 0 in 0.257s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Lock "cinder-quobyte-8360194d-cb97-45fb-a1f7-392eeba7dbea" released by "_copy_volume_from_snapshot" :: held 6.082s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Lock "cinder-quobyte-5650d4cd-75ff-4f18-bc48-0f2e4931449a-8360194d-cb97-45fb-a1f7-392eeba7dbea" released by "_create_volume_from_snapshot" :: held 6.153s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.171s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.398s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892535401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3047c7-3e63-46fd-a6a4-db93fdfb424b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6ceb3234b46a4b8cb6b06de47d03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:04Z,use_quota=True,user_id='651651ec609e4eeda1eecd55281a7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Creating volume 5a3047c7-3e63-46fd-a6a4-db93fdfb424b {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:38:09 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:09 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b 1073741824 Sep 10 18:38:09 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0223994-722f-4efc-88fc-1947c6daa3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8360194d-cb97-45fb-a1f7-392eeba7dbea', 'volume_size': 1, 'snapshot_id': '5650d4cd-75ff-4f18-bc48-0f2e4931449a'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7558907-f9c4-4285-bce7-e4459fb45730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:09 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Volume volume-8360194d-cb97-45fb-a1f7-392eeba7dbea (8360194d-cb97-45fb-a1f7-392eeba7dbea): created successfully Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7558907-f9c4-4285-bce7-e4459fb45730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Flow 'volume_create_manager' (a54d5a3a-883e-4437-8c39-7e80ecdfefc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:09 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-73bb34d8-622e-486a-86af-ae12dda6e2f1 tempest-VolumeDependencyTests-847876440 None] Created volume successfully. Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] Acquiring lock "cinder-5650d4cd-75ff-4f18-bc48-0f2e4931449a-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] Lock "cinder-5650d4cd-75ff-4f18-bc48-0f2e4931449a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] Acquiring lock "cinder-quobyte-4d695306-5105-438f-906f-3c2a5c527b03" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] Lock "cinder-quobyte-4d695306-5105-438f-906f-3c2a5c527b03" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] Acquiring lock "cinder-quobyte-5650d4cd-75ff-4f18-bc48-0f2e4931449a" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] Lock "cinder-quobyte-5650d4cd-75ff-4f18-bc48-0f2e4931449a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] Deleting offline snapshot 5650d4cd-75ff-4f18-bc48-0f2e4931449a of volume 4d695306-5105-438f-906f-3c2a5c527b03 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] snapshot_file for this snap is: volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba2db4d-72fd-4868-ab1e-320655e5b377]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:09 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a Sep 10 18:38:09 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:09 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b 1073741824" returned: 0 in 0.571s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:09 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b Sep 10 18:38:09 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:09 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a" returned: 0 in 0.390s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d695306-5105-438f-906f-3c2a5c527b03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ce75d1-50dc-4afb-bac1-30cbc176d855]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:09 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b" returned: 0 in 0.260s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.669s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-284051952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f684556-fbac-4112-bb17-5d5040918d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71593563d3364f8588e871418208ef5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:04Z,use_quota=True,user_id='c6187dd4b31e42058e2ad7596b1c0f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Creating volume 6f684556-fbac-4112-bb17-5d5040918d80 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:38:10 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e175a7-aee6-4adb-98dd-d3c357e1bea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:10 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80 1073741824 Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236cca9b-5403-44ed-9070-e7a4af955b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:10 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:10 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Volume volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b (5a3047c7-3e63-46fd-a6a4-db93fdfb424b): created successfully Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236cca9b-5403-44ed-9070-e7a4af955b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Flow 'volume_create_manager' (6d0fee6d-5984-45db-8031-f3b6fe407244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:10 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4bd45645-9a12-4343-94a2-93585a4dec61 tempest-ProjectMemberTests-1340142452 None] Created volume successfully. Sep 10 18:38:10 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03 Sep 10 18:38:10 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e34888de-6dc2-4c9a-adef-404e992b6876 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:10 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80 1073741824" returned: 0 in 0.562s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:10 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03" returned: 0 in 0.659s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:10 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80 Sep 10 18:38:10 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:10 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a Sep 10 18:38:10 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:10 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80" returned: 0 in 0.277s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e34888de-6dc2-4c9a-adef-404e992b6876 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.365s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28bf304a-3877-430e-b361-27e8f0c81418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f684556-fbac-4112-bb17-5d5040918d80', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3860cc-0a35-469c-b694-38e3b578bf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-e34888de-6dc2-4c9a-adef-404e992b6876 tempest-ProjectMemberTests-1340142452 None] Creating offline snapshot 33695ff3-a1aa-4114-8ee1-dbe08571cc33 of volume 5a3047c7-3e63-46fd-a6a4-db93fdfb424b {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:38:10 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Volume volume-6f684556-fbac-4112-bb17-5d5040918d80 (6f684556-fbac-4112-bb17-5d5040918d80): created successfully Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3860cc-0a35-469c-b694-38e3b578bf23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Flow 'volume_create_manager' (630f7018-2c8c-4e6d-90c0-2a5c96736fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4623631e-ee56-4417-bef2-be5eb6c2037e]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e34888de-6dc2-4c9a-adef-404e992b6876 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:10 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-08dc3a96-8fb7-4a25-aa82-db95a7cd7a20 tempest-CinderUnicodeTest-633965965 None] Created volume successfully. Sep 10 18:38:11 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a" returned: 0 in 0.382s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:11 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a Sep 10 18:38:11 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:11 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b Sep 10 18:38:11 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:11 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03.5650d4cd-75ff-4f18-bc48-0f2e4931449a" returned: 0 in 0.285s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:11 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:11 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] Lock "cinder-quobyte-5650d4cd-75ff-4f18-bc48-0f2e4931449a" released by "_delete_snapshot" :: held 1.840s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e34888de-6dc2-4c9a-adef-404e992b6876 tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b" returned: 0 in 0.399s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e34888de-6dc2-4c9a-adef-404e992b6876 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:11 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] Lock "cinder-quobyte-4d695306-5105-438f-906f-3c2a5c527b03" released by "delete_snapshot" :: held 1.884s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:11 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33 1G Sep 10 18:38:11 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:11 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] Created reservations ['357f632a-5b78-4b4e-8240-47fec9eb2b47', '9876aebc-3bd9-47d9-8ef7-34ba827c6d70', 'cc5603ba-27c1-4d36-b873-5bb4825e00d5', '2d9710ee-de77-435f-a8c0-77dfdcbaee5f'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:11 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] Delete snapshot completed successfully. Sep 10 18:38:11 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e8bf41e3-5955-4e21-afdd-2654724d0e34 tempest-VolumeDependencyTests-847876440 None] Lock "cinder-5650d4cd-75ff-4f18-bc48-0f2e4931449a-delete_snapshot" released by "delete_snapshot" :: held 2.053s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:11 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] Acquiring lock "cinder-4d695306-5105-438f-906f-3c2a5c527b03-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:11 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] Lock "cinder-4d695306-5105-438f-906f-3c2a5c527b03-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:11 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] Acquiring lock "cinder-quobyte-4d695306-5105-438f-906f-3c2a5c527b03" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:11 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] Lock "cinder-quobyte-4d695306-5105-438f-906f-3c2a5c527b03" acquired by "delete_volume" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:11 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[743b5a3c-0fef-4094-b650-a65f6e8c1cd7]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:11 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03 Sep 10 18:38:11 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:11 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e34888de-6dc2-4c9a-adef-404e992b6876 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33 1G" returned: 0 in 0.511s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e34888de-6dc2-4c9a-adef-404e992b6876 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:11 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33 Sep 10 18:38:11 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fe4db5f4-d99d-44fa-8f33-e1ffe989b3e2 tempest-CinderUnicodeTest-633965965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:12 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03" returned: 0 in 0.441s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:12 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03 Sep 10 18:38:12 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:12 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e34888de-6dc2-4c9a-adef-404e992b6876 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33" returned: 0 in 0.375s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:12 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-e34888de-6dc2-4c9a-adef-404e992b6876 tempest-ProjectMemberTests-1340142452 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33 is being set with open permissions: ugo+rw Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e34888de-6dc2-4c9a-adef-404e992b6876 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:12 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33 Sep 10 18:38:12 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:12 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4d695306-5105-438f-906f-3c2a5c527b03" returned: 0 in 0.263s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] Lock "cinder-quobyte-4d695306-5105-438f-906f-3c2a5c527b03" released by "delete_volume" :: held 0.783s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:12 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e34888de-6dc2-4c9a-adef-404e992b6876 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33" returned: 0 in 0.276s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e34888de-6dc2-4c9a-adef-404e992b6876 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] Created reservations ['eede82bf-c740-41d4-9d19-c29842f5a3d4', '338027c6-8d12-443b-9c49-e8666b41c1c9', 'cd41e7b2-ecf1-48ff-bb1a-e43ee3dc7c0a', '7917eacb-aeb3-461d-8039-06215d41edfe'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:12 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.info Sep 10 18:38:12 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:12 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:12 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] Acquiring lock "cinder-8360194d-cb97-45fb-a1f7-392eeba7dbea-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] Lock "cinder-8360194d-cb97-45fb-a1f7-392eeba7dbea-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:12 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e34888de-6dc2-4c9a-adef-404e992b6876 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.info" returned: 0 in 0.312s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:12 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-e34888de-6dc2-4c9a-adef-404e992b6876 tempest-ProjectMemberTests-1340142452 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.info is being set with open permissions: ugo+rw Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e34888de-6dc2-4c9a-adef-404e992b6876 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:12 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.info Sep 10 18:38:12 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] Acquiring lock "cinder-quobyte-8360194d-cb97-45fb-a1f7-392eeba7dbea" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] Lock "cinder-quobyte-8360194d-cb97-45fb-a1f7-392eeba7dbea" acquired by "delete_volume" :: waited 0.027s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:12 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.320s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:12 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:12 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] Deleted volume successfully. Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ef9618-ccc6-492c-a7fa-87c0032778b4]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8360194d-cb97-45fb-a1f7-392eeba7dbea {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-da0b15bc-fc94-4ec3-8d28-921df07b2ba8 tempest-VolumeDependencyTests-847876440 None] Lock "cinder-4d695306-5105-438f-906f-3c2a5c527b03-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:13 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8360194d-cb97-45fb-a1f7-392eeba7dbea Sep 10 18:38:13 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:13 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e34888de-6dc2-4c9a-adef-404e992b6876 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.info" returned: 0 in 0.316s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e34888de-6dc2-4c9a-adef-404e992b6876 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fe4db5f4-d99d-44fa-8f33-e1ffe989b3e2 tempest-CinderUnicodeTest-633965965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.052s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-fe4db5f4-d99d-44fa-8f33-e1ffe989b3e2 tempest-CinderUnicodeTest-633965965 None] Creating offline snapshot 768338b5-e052-48d3-b61b-249909bfbc5f of volume 6f684556-fbac-4112-bb17-5d5040918d80 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:38:13 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e34888de-6dc2-4c9a-adef-404e992b6876 tempest-ProjectMemberTests-1340142452 None] Create snapshot completed successfully Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5d064a-8187-4c90-bcc9-d5339b16098d]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe4db5f4-d99d-44fa-8f33-e1ffe989b3e2 tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:13 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80 Sep 10 18:38:13 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:38:13 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Flow 'volume_create_manager' (5915caec-8d6a-47c6-ab23-3938e9158f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd4dcd2-64e7-40b9-abdd-003f1d450c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8360194d-cb97-45fb-a1f7-392eeba7dbea" returned: 0 in 0.514s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8360194d-cb97-45fb-a1f7-392eeba7dbea {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd4dcd2-64e7-40b9-abdd-003f1d450c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95eb7fa6-1403-4cc7-8393-2963b362ca14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cacc9b8b4efd4cd0a6bfbf389d01d8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:13Z,use_quota=True,user_id='9041b44c75c2411d99e1c535fcdfc74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:13 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8360194d-cb97-45fb-a1f7-392eeba7dbea Sep 10 18:38:13 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da73d47d-1c25-4386-b631-c4cec8860e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da73d47d-1c25-4386-b631-c4cec8860e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e373b14-cb61-4ff0-8c42-f315c69626b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.image.glance [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Creating Keystone auth plugin from conf {{(pid=87842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-33695ff3-a1aa-4114-8ee1-dbe08571cc33-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] Lock "cinder-33695ff3-a1aa-4114-8ee1-dbe08571cc33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-5a3047c7-3e63-46fd-a6a4-db93fdfb424b" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-5a3047c7-3e63-46fd-a6a4-db93fdfb424b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-33695ff3-a1aa-4114-8ee1-dbe08571cc33" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:13 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe4db5f4-d99d-44fa-8f33-e1ffe989b3e2 tempest-CinderUnicodeTest-633965965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80" returned: 0 in 0.457s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe4db5f4-d99d-44fa-8f33-e1ffe989b3e2 tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-33695ff3-a1aa-4114-8ee1-dbe08571cc33" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] Deleting offline snapshot 33695ff3-a1aa-4114-8ee1-dbe08571cc33 of volume 5a3047c7-3e63-46fd-a6a4-db93fdfb424b {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:38:13 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f 1G Sep 10 18:38:13 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] snapshot_file for this snap is: volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c204997-c417-4843-b86e-fc824b3d316a]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:13 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-8360194d-cb97-45fb-a1f7-392eeba7dbea" returned: 0 in 0.366s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] Lock "cinder-quobyte-8360194d-cb97-45fb-a1f7-392eeba7dbea" released by "delete_volume" :: held 0.939s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e373b14-cb61-4ff0-8c42-f315c69626b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '95eb7fa6-1403-4cc7-8393-2963b362ca14', 'volume_name': 'volume-95eb7fa6-1403-4cc7-8393-2963b362ca14', 'volume_size': 1, 'image_id': 'db07ee03-4905-4a4c-8510-ae40c4d67230', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db07ee03-4905-4a4c-8510-ae40c4d67230', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fddc929bb11319e8f4ca993e45f5c48d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cacc9b8b4efd4cd0a6bfbf389d01d8af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0335885b652775ce9c2f6fffef138ab3f12dfa1ddba0f5a46e49d2a8751026c5d36d63a62b70b19c6237496291ee009584ea92bec4b0989c6498d9d4d34bf1d5', 'id': 'db07ee03-4905-4a4c-8510-ae40c4d67230', 'created_at': datetime.datetime(2026, 9, 10, 16, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 38, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db07ee03-4905-4a4c-8510-ae40c4d67230/file', 'properties': {}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:13 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33 Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b7f4a2-9922-4199-ba88-886f0774eb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:13 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b7f4a2-9922-4199-ba88-886f0774eb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d94d61-a692-4029-8fe7-30fc6e988728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:13 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Volume 95eb7fa6-1403-4cc7-8393-2963b362ca14: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-95eb7fa6-1403-4cc7-8393-2963b362ca14', 'volume_size': 1, 'image_id': 'db07ee03-4905-4a4c-8510-ae40c4d67230', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db07ee03-4905-4a4c-8510-ae40c4d67230', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fddc929bb11319e8f4ca993e45f5c48d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cacc9b8b4efd4cd0a6bfbf389d01d8af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0335885b652775ce9c2f6fffef138ab3f12dfa1ddba0f5a46e49d2a8751026c5d36d63a62b70b19c6237496291ee009584ea92bec4b0989c6498d9d4d34bf1d5', 'id': 'db07ee03-4905-4a4c-8510-ae40c4d67230', 'created_at': datetime.datetime(2026, 9, 10, 16, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 38, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db07ee03-4905-4a4c-8510-ae40c4d67230/file', 'properties': {}}, 'image_service': } Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Trying to clone 95eb7fa6-1403-4cc7-8393-2963b362ca14 from image db07ee03-4905-4a4c-8510-ae40c4d67230 at location (None, [{'url': 'file:///opt/stack/data/glance/images/db07ee03-4905-4a4c-8510-ae40c4d67230', 'metadata': {}}]). {{(pid=87842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 10 18:38:13 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] Created reservations ['5c35ee93-5cb7-4193-81be-1ddbc61bebf7', 'd68d52e3-f1d2-4ca6-a0d7-f5b9d94fb57b', '104bd12a-fcf4-4b8f-aecb-a5c4637bb084', 'c973200d-8664-49c3-83d4-623136550f3e'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 10 18:38:14 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Image download 0.00 MB at 0.00 MB/s Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:14 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:14 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e505114-37da-4234-b9a4-5a03b2b53988]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:14 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe4db5f4-d99d-44fa-8f33-e1ffe989b3e2 tempest-CinderUnicodeTest-633965965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f 1G" returned: 0 in 0.501s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe4db5f4-d99d-44fa-8f33-e1ffe989b3e2 tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f684556-fbac-4112-bb17-5d5040918d80 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:14 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD Sep 10 18:38:14 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:14 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33" returned: 0 in 0.466s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:38:14 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f684556-fbac-4112-bb17-5d5040918d80 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f Sep 10 18:38:14 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a21784-36ba-430c-9695-78648e88e1bd]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:14 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.305s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:14 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] Deleted volume successfully. Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b708ff93-b331-452d-91a1-4d25fb2f50de tempest-VolumeDependencyTests-847876440 None] Lock "cinder-8360194d-cb97-45fb-a1f7-392eeba7dbea-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:14 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b Sep 10 18:38:14 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:14 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:14 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe4db5f4-d99d-44fa-8f33-e1ffe989b3e2 tempest-CinderUnicodeTest-633965965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f684556-fbac-4112-bb17-5d5040918d80 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f" returned: 0 in 0.325s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:14 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-fe4db5f4-d99d-44fa-8f33-e1ffe989b3e2 tempest-CinderUnicodeTest-633965965 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f is being set with open permissions: ugo+rw Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe4db5f4-d99d-44fa-8f33-e1ffe989b3e2 tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:14 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f Sep 10 18:38:14 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:14 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD Sep 10 18:38:14 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:14 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b" returned: 0 in 0.425s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:14 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33 Sep 10 18:38:14 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:14 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe4db5f4-d99d-44fa-8f33-e1ffe989b3e2 tempest-CinderUnicodeTest-633965965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f" returned: 0 in 0.267s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe4db5f4-d99d-44fa-8f33-e1ffe989b3e2 tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:14 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Temporary image db07ee03-4905-4a4c-8510-ae40c4d67230 is fetched for user 9041b44c75c2411d99e1c535fcdfc74d. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 10 18:38:14 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.info Sep 10 18:38:14 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4395fe00-2a64-4dc2-9229-b19c35a17e21]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:15 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD Sep 10 18:38:15 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:15 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33" returned: 0 in 0.388s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:15 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33 Sep 10 18:38:15 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:15 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe4db5f4-d99d-44fa-8f33-e1ffe989b3e2 tempest-CinderUnicodeTest-633965965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.info" returned: 0 in 0.296s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:15 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-fe4db5f4-d99d-44fa-8f33-e1ffe989b3e2 tempest-CinderUnicodeTest-633965965 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.info is being set with open permissions: ugo+rw Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe4db5f4-d99d-44fa-8f33-e1ffe989b3e2 tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:15 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.info Sep 10 18:38:15 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:15 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:15 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b.33695ff3-a1aa-4114-8ee1-dbe08571cc33" returned: 0 in 0.299s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:15 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD Sep 10 18:38:15 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:15 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-33695ff3-a1aa-4114-8ee1-dbe08571cc33" released by "_delete_snapshot" :: held 1.739s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe4db5f4-d99d-44fa-8f33-e1ffe989b3e2 tempest-CinderUnicodeTest-633965965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.info" returned: 0 in 0.338s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fe4db5f4-d99d-44fa-8f33-e1ffe989b3e2 tempest-CinderUnicodeTest-633965965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-5a3047c7-3e63-46fd-a6a4-db93fdfb424b" released by "delete_snapshot" :: held 1.816s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:15 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-fe4db5f4-d99d-44fa-8f33-e1ffe989b3e2 tempest-CinderUnicodeTest-633965965 None] Create snapshot completed successfully Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] Created reservations ['fa41a0ec-6457-4a74-b9ea-b409419cb29c', '5b741b4d-6b96-42c2-921b-89c1c73f5c74', 'eb9a8f8b-9b66-433e-a813-c25508a2163c', '324cb7cc-8721-4d63-96d4-2a4910115b5f'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:15 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] Delete snapshot completed successfully. Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-a088e58c-112c-417b-9f86-2c3ad90401af tempest-ProjectMemberTests-1340142452 None] Lock "cinder-33695ff3-a1aa-4114-8ee1-dbe08571cc33-delete_snapshot" released by "delete_snapshot" :: held 1.981s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:15 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95eb7fa6-1403-4cc7-8393-2963b362ca14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cacc9b8b4efd4cd0a6bfbf389d01d8af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:13Z,use_quota=True,user_id='9041b44c75c2411d99e1c535fcdfc74d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Creating volume 95eb7fa6-1403-4cc7-8393-2963b362ca14 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:38:15 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-95eb7fa6-1403-4cc7-8393-2963b362ca14 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:15 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-95eb7fa6-1403-4cc7-8393-2963b362ca14 1073741824 Sep 10 18:38:15 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-5a3047c7-3e63-46fd-a6a4-db93fdfb424b-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] Lock "cinder-5a3047c7-3e63-46fd-a6a4-db93fdfb424b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:15 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-5a3047c7-3e63-46fd-a6a4-db93fdfb424b" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-5a3047c7-3e63-46fd-a6a4-db93fdfb424b" acquired by "delete_volume" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eaf728-e22b-47ba-a6e1-f9455b85facf]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:16 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b Sep 10 18:38:16 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:16 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-95eb7fa6-1403-4cc7-8393-2963b362ca14 1073741824" returned: 0 in 0.488s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-95eb7fa6-1403-4cc7-8393-2963b362ca14 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:16 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-95eb7fa6-1403-4cc7-8393-2963b362ca14 Sep 10 18:38:16 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] Acquiring lock "cinder-768338b5-e052-48d3-b61b-249909bfbc5f-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] Lock "cinder-768338b5-e052-48d3-b61b-249909bfbc5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] Acquiring lock "cinder-quobyte-6f684556-fbac-4112-bb17-5d5040918d80" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] Lock "cinder-quobyte-6f684556-fbac-4112-bb17-5d5040918d80" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] Acquiring lock "cinder-quobyte-768338b5-e052-48d3-b61b-249909bfbc5f" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] Lock "cinder-quobyte-768338b5-e052-48d3-b61b-249909bfbc5f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] Deleting offline snapshot 768338b5-e052-48d3-b61b-249909bfbc5f of volume 6f684556-fbac-4112-bb17-5d5040918d80 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] snapshot_file for this snap is: volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e769d12-4417-4d09-9ffa-62b8164c78ea]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:16 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b" returned: 0 in 0.500s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:16 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-95eb7fa6-1403-4cc7-8393-2963b362ca14" returned: 0 in 0.329s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:16 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b Sep 10 18:38:16 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Attempting download of db07ee03-4905-4a4c-8510-ae40c4d67230 ((None, [{'url': 'file:///opt/stack/data/glance/images/db07ee03-4905-4a4c-8510-ae40c4d67230', 'metadata': {}}])) to volume 95eb7fa6-1403-4cc7-8393-2963b362ca14. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 10 18:38:16 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f Sep 10 18:38:16 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6ffce2-6f13-4ccc-bce0-ebd6e34bfc17]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db07ee03-4905-4a4c-8510-ae40c4d67230_hykh3ylc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:16 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-5a3047c7-3e63-46fd-a6a4-db93fdfb424b" returned: 0 in 0.322s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:16 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db07ee03-4905-4a4c-8510-ae40c4d67230_hykh3ylc Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-5a3047c7-3e63-46fd-a6a4-db93fdfb424b" released by "delete_volume" :: held 0.894s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:16 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:16 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] Created reservations ['95636042-4907-414e-a5f0-0bcc5c391b64', '9536130f-7b52-4730-ac55-7d8f6ca77228', 'ed7d221c-6553-48fa-ba6b-331f8896602b', 'bcc413f7-233d-470d-b82a-fa85e7e877e8'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:17 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f" returned: 0 in 0.550s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f684556-fbac-4112-bb17-5d5040918d80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:38:17 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:17 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e655647-2ae5-4f41-9cc1-ac719bda8aa2]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:17 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db07ee03-4905-4a4c-8510-ae40c4d67230_hykh3ylc" returned: 0 in 0.420s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db07ee03-4905-4a4c-8510-ae40c4d67230_hykh3ylc {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:17 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db07ee03-4905-4a4c-8510-ae40c4d67230_hykh3ylc Sep 10 18:38:17 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:17 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80 Sep 10 18:38:17 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:17 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.387s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:17 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] Deleted volume successfully. Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d1d18a2c-462e-4db8-8e39-ac2ba916a7cb tempest-ProjectMemberTests-1340142452 None] Lock "cinder-5a3047c7-3e63-46fd-a6a4-db93fdfb424b-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:17 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db07ee03-4905-4a4c-8510-ae40c4d67230_hykh3ylc" returned: 1 in 0.435s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db07ee03-4905-4a4c-8510-ae40c4d67230_hykh3ylc' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[812d6098-49d4-4272-b07e-97601cf30a66]: (4, 'raw') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:17 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD Sep 10 18:38:17 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Flow 'volume_create_manager' (30d03103-cbd1-4958-b4af-15f793b9685d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35020a12-0d5c-4e1e-b245-657abb3514ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35020a12-0d5c-4e1e-b245-657abb3514ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2132095103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88ee376-db64-48ad-8865-cc9063032e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6ceb3234b46a4b8cb6b06de47d03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:18Z,use_quota=True,user_id='651651ec609e4eeda1eecd55281a7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:17 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eeccda1-4bd8-4b6b-a1f2-5dfadaa87a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eeccda1-4bd8-4b6b-a1f2-5dfadaa87a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c08177c-861e-4a28-8c9c-d506b73dc996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c08177c-861e-4a28-8c9c-d506b73dc996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e88ee376-db64-48ad-8865-cc9063032e94', 'volume_name': 'volume-e88ee376-db64-48ad-8865-cc9063032e94', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095c2087-8ff4-4a69-8d38-a6675cfba07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095c2087-8ff4-4a69-8d38-a6675cfba07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9952469c-a150-4a58-8e4a-8d8d8a64073e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:17 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Volume e88ee376-db64-48ad-8865-cc9063032e94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e88ee376-db64-48ad-8865-cc9063032e94', 'volume_size': 1} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2132095103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88ee376-db64-48ad-8865-cc9063032e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6ceb3234b46a4b8cb6b06de47d03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:18Z,use_quota=True,user_id='651651ec609e4eeda1eecd55281a7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Creating volume e88ee376-db64-48ad-8865-cc9063032e94 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:38:17 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80" returned: 0 in 0.803s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:17 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94 1073741824 Sep 10 18:38:17 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:17 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f Sep 10 18:38:17 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:18 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:18 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD Sep 10 18:38:18 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:18 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f" returned: 0 in 0.405s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:18 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f Sep 10 18:38:18 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:18 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94 1073741824" returned: 0 in 0.508s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:18 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD" returned: 1 in 0.450s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] db07ee03-4905-4a4c-8510-ae40c4d67230 was raw, converting to qcow2 {{(pid=87842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-95eb7fa6-1403-4cc7-8393-2963b362ca14 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:18 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94 Sep 10 18:38:18 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:18 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-95eb7fa6-1403-4cc7-8393-2963b362ca14 Sep 10 18:38:18 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:18 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80.768338b5-e052-48d3-b61b-249909bfbc5f" returned: 0 in 0.323s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] Lock "cinder-quobyte-768338b5-e052-48d3-b61b-249909bfbc5f" released by "_delete_snapshot" :: held 2.244s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] Lock "cinder-quobyte-6f684556-fbac-4112-bb17-5d5040918d80" released by "delete_snapshot" :: held 2.274s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:18 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] Created reservations ['31b8ee68-71d8-4860-b4a4-b8857cd8702a', '790388bb-d076-45fb-a160-16abf00cbd16', 'ebe3780d-7b67-4489-9ea5-d80d0bfba1bc', '8ee5a644-e140-4a23-90df-a439f6ca6aae'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94" returned: 0 in 0.366s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9952469c-a150-4a58-8e4a-8d8d8a64073e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e88ee376-db64-48ad-8865-cc9063032e94', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e1734e-770e-48bb-b5b5-4703c526404a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:18 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Volume volume-e88ee376-db64-48ad-8865-cc9063032e94 (e88ee376-db64-48ad-8865-cc9063032e94): created successfully Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e1734e-770e-48bb-b5b5-4703c526404a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Flow 'volume_create_manager' (30d03103-cbd1-4958-b4af-15f793b9685d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:18 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-163583ec-6c77-4926-8f30-5623cdf98b0d tempest-ProjectMemberTests-1340142452 None] Created volume successfully. Sep 10 18:38:18 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] Delete snapshot completed successfully. Sep 10 18:38:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bba43672-567e-4c38-b0aa-0e1c82653274 tempest-CinderUnicodeTest-633965965 None] Lock "cinder-768338b5-e052-48d3-b61b-249909bfbc5f-delete_snapshot" released by "delete_snapshot" :: held 2.493s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:19 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-95eb7fa6-1403-4cc7-8393-2963b362ca14" returned: 0 in 0.553s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_db07ee03-4905-4a4c-8510-ae40c4d67230_bwuwlkdjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-95eb7fa6-1403-4cc7-8393-2963b362ca14 {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:38:19 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-95eb7fa6-1403-4cc7-8393-2963b362ca14 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:19 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-95eb7fa6-1403-4cc7-8393-2963b362ca14 1G Sep 10 18:38:19 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-5e0e3704-c5c9-424e-9b90-2831cb8c9c28 tempest-ProjectAdminTests-1200460164 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2273559570312, 'free_capacity_gb': 1773.2273559570312, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87842) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 10 18:38:19 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-95eb7fa6-1403-4cc7-8393-2963b362ca14 1G" returned: 0 in 0.333s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Downloaded image db07ee03-4905-4a4c-8510-ae40c4d67230 ((None, [{'url': 'file:///opt/stack/data/glance/images/db07ee03-4905-4a4c-8510-ae40c4d67230', 'metadata': {}}])) to volume 95eb7fa6-1403-4cc7-8393-2963b362ca14 successfully. {{(pid=87842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Temporary image db07ee03-4905-4a4c-8510-ae40c4d67230 for user 9041b44c75c2411d99e1c535fcdfc74d is deleted. {{(pid=87842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG cinder.volume.volume_utils [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Marking volume 95eb7fa6-1403-4cc7-8393-2963b362ca14 as bootable. {{(pid=87842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Copying metadata from image db07ee03-4905-4a4c-8510-ae40c4d67230 to 95eb7fa6-1403-4cc7-8393-2963b362ca14. {{(pid=87842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Creating volume glance metadata for volume 95eb7fa6-1403-4cc7-8393-2963b362ca14 backed by image db07ee03-4905-4a4c-8510-ae40c4d67230 with: {'image_id': 'db07ee03-4905-4a4c-8510-ae40c4d67230', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fddc929bb11319e8f4ca993e45f5c48d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d94d61-a692-4029-8fe7-30fc6e988728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95eb7fa6-1403-4cc7-8393-2963b362ca14', 'volume_size': 1, 'image_id': 'db07ee03-4905-4a4c-8510-ae40c4d67230', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db07ee03-4905-4a4c-8510-ae40c4d67230', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fddc929bb11319e8f4ca993e45f5c48d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cacc9b8b4efd4cd0a6bfbf389d01d8af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0335885b652775ce9c2f6fffef138ab3f12dfa1ddba0f5a46e49d2a8751026c5d36d63a62b70b19c6237496291ee009584ea92bec4b0989c6498d9d4d34bf1d5', 'id': 'db07ee03-4905-4a4c-8510-ae40c4d67230', 'created_at': datetime.datetime(2026, 9, 10, 16, 38, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 10, 16, 38, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db07ee03-4905-4a4c-8510-ae40c4d67230/file', 'properties': {}}, 'image_service': }' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335c0920-5fc2-4845-8c7c-9790c5ae4700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:19 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Volume volume-95eb7fa6-1403-4cc7-8393-2963b362ca14 (95eb7fa6-1403-4cc7-8393-2963b362ca14): created successfully Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335c0920-5fc2-4845-8c7c-9790c5ae4700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Flow 'volume_create_manager' (5915caec-8d6a-47c6-ab23-3938e9158f19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:19 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-cdd39ad0-92d4-48d8-a337-29b006b5ed29 tempest-VolumeImageDependencyTests-315202494 None] Created volume successfully. Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] Acquiring lock "cinder-6f684556-fbac-4112-bb17-5d5040918d80-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] Lock "cinder-6f684556-fbac-4112-bb17-5d5040918d80-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] Acquiring lock "cinder-quobyte-6f684556-fbac-4112-bb17-5d5040918d80" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] Lock "cinder-quobyte-6f684556-fbac-4112-bb17-5d5040918d80" acquired by "delete_volume" :: waited 0.017s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e66d666-6cf9-4e4a-a7b3-c90274a7eea5]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:19 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:19 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80 Sep 10 18:38:19 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] Acquiring lock "cinder-95eb7fa6-1403-4cc7-8393-2963b362ca14-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] Lock "cinder-95eb7fa6-1403-4cc7-8393-2963b362ca14-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9cb012fa-438a-49ef-a0fc-ca6eca1fdab2 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9cb012fa-438a-49ef-a0fc-ca6eca1fdab2 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-9cb012fa-438a-49ef-a0fc-ca6eca1fdab2 tempest-ProjectMemberTests-1340142452 None] Creating offline snapshot 5b7dbd08-388d-4ee8-935a-f0e317867f83 of volume e88ee376-db64-48ad-8865-cc9063032e94 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] Acquiring lock "cinder-quobyte-95eb7fa6-1403-4cc7-8393-2963b362ca14" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4285415a-eca3-4cfc-bbb6-38ca16e063f3]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9cb012fa-438a-49ef-a0fc-ca6eca1fdab2 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] Lock "cinder-quobyte-95eb7fa6-1403-4cc7-8393-2963b362ca14" acquired by "delete_volume" :: waited 0.036s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d607f67d-3a55-437e-969c-cda9a54c39d6]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-95eb7fa6-1403-4cc7-8393-2963b362ca14 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:20 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80" returned: 0 in 0.449s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:20 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80 Sep 10 18:38:20 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:20 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94 Sep 10 18:38:20 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:20 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-95eb7fa6-1403-4cc7-8393-2963b362ca14 Sep 10 18:38:20 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:20 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6f684556-fbac-4112-bb17-5d5040918d80" returned: 0 in 0.360s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] Lock "cinder-quobyte-6f684556-fbac-4112-bb17-5d5040918d80" released by "delete_volume" :: held 0.887s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:20 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9cb012fa-438a-49ef-a0fc-ca6eca1fdab2 tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94" returned: 0 in 0.482s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9cb012fa-438a-49ef-a0fc-ca6eca1fdab2 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:20 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83 1G Sep 10 18:38:20 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:20 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-95eb7fa6-1403-4cc7-8393-2963b362ca14" returned: 0 in 0.469s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-95eb7fa6-1403-4cc7-8393-2963b362ca14 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:20 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-95eb7fa6-1403-4cc7-8393-2963b362ca14 Sep 10 18:38:20 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] Created reservations ['379691ad-5fdc-4c7c-a3c5-6a7e4b57cf2d', 'c7066918-3b53-4e4c-b969-c7dce382279a', '48e324e3-baf7-4e1d-a18a-bc6e2acb45bb', '2cbfa817-115f-4e75-98ac-0eff0357adc0'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:20 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:20 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:21 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-95eb7fa6-1403-4cc7-8393-2963b362ca14" returned: 0 in 0.397s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] Lock "cinder-quobyte-95eb7fa6-1403-4cc7-8393-2963b362ca14" released by "delete_volume" :: held 0.934s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:21 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:21 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9cb012fa-438a-49ef-a0fc-ca6eca1fdab2 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83 1G" returned: 0 in 0.528s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.316s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9cb012fa-438a-49ef-a0fc-ca6eca1fdab2 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88ee376-db64-48ad-8865-cc9063032e94 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:21 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] Deleted volume successfully. Sep 10 18:38:21 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88ee376-db64-48ad-8865-cc9063032e94 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83 Sep 10 18:38:21 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] Created reservations ['b5f1a1f3-04b8-42c4-aaf5-5e4370b428cf', '786e2d51-efc2-494e-b253-431c31738867', 'ac61b069-7ed4-4540-b5f0-2a00f6df144e', 'a482a547-ed34-4a3b-9bd1-b7ae38b8cc47'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-fe21b8d3-be27-4cb8-aa33-f22bcbd22560 tempest-CinderUnicodeTest-633965965 None] Lock "cinder-6f684556-fbac-4112-bb17-5d5040918d80-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:21 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:21 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:21 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9cb012fa-438a-49ef-a0fc-ca6eca1fdab2 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88ee376-db64-48ad-8865-cc9063032e94 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83" returned: 0 in 0.343s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:21 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-9cb012fa-438a-49ef-a0fc-ca6eca1fdab2 tempest-ProjectMemberTests-1340142452 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83 is being set with open permissions: ugo+rw Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9cb012fa-438a-49ef-a0fc-ca6eca1fdab2 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:21 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83 Sep 10 18:38:21 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:21 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.293s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:21 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] Deleted volume successfully. Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-3ecc5d56-95c0-44b9-afb4-024621caffc6 tempest-VolumeImageDependencyTests-315202494 None] Lock "cinder-95eb7fa6-1403-4cc7-8393-2963b362ca14-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:21 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9cb012fa-438a-49ef-a0fc-ca6eca1fdab2 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83" returned: 0 in 0.263s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9cb012fa-438a-49ef-a0fc-ca6eca1fdab2 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:21 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.info Sep 10 18:38:21 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] Acquiring lock "cinder-4b1873b4-c33a-4cfc-9f6d-3e8913c39555-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] Lock "cinder-4b1873b4-c33a-4cfc-9f6d-3e8913c39555-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] Acquiring lock "cinder-quobyte-4b1873b4-c33a-4cfc-9f6d-3e8913c39555" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] Lock "cinder-quobyte-4b1873b4-c33a-4cfc-9f6d-3e8913c39555" acquired by "delete_volume" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[322e4e6e-daf3-49bb-8050-f3530fcc6a6a]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b1873b4-c33a-4cfc-9f6d-3e8913c39555 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:22 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9cb012fa-438a-49ef-a0fc-ca6eca1fdab2 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.info" returned: 0 in 0.277s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:22 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-9cb012fa-438a-49ef-a0fc-ca6eca1fdab2 tempest-ProjectMemberTests-1340142452 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.info is being set with open permissions: ugo+rw Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9cb012fa-438a-49ef-a0fc-ca6eca1fdab2 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:22 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.info Sep 10 18:38:22 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:22 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b1873b4-c33a-4cfc-9f6d-3e8913c39555 Sep 10 18:38:22 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:22 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9cb012fa-438a-49ef-a0fc-ca6eca1fdab2 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.info" returned: 0 in 0.330s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9cb012fa-438a-49ef-a0fc-ca6eca1fdab2 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.330s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:22 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-9cb012fa-438a-49ef-a0fc-ca6eca1fdab2 tempest-ProjectMemberTests-1340142452 None] Create snapshot completed successfully Sep 10 18:38:22 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b1873b4-c33a-4cfc-9f6d-3e8913c39555" returned: 0 in 0.444s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b1873b4-c33a-4cfc-9f6d-3e8913c39555 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:22 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b1873b4-c33a-4cfc-9f6d-3e8913c39555 Sep 10 18:38:22 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:22 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4b1873b4-c33a-4cfc-9f6d-3e8913c39555" returned: 0 in 0.276s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] Lock "cinder-quobyte-4b1873b4-c33a-4cfc-9f6d-3e8913c39555" released by "delete_volume" :: held 0.765s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:UPDATE=314,cinder:SELECT=235,cinder:INSERT=85,cinder:DELETE=30 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] Created reservations ['8d7213fb-4017-4446-9e82-06582f1cf3df', 'ed7844fc-d9b7-41d8-b3da-f754f843aeff', 'f62d2263-50fc-4d68-8d14-74f8071d11fa', '612b097b-e0fc-493f-899d-9cfa6eb9e726'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:23 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:23 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:23 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.342s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:23 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:23 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] Deleted volume successfully. Sep 10 18:38:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-db1f220c-c742-42d3-91d7-2382cef013ac tempest-CinderUnicodeTest-633965965 None] Lock "cinder-4b1873b4-c33a-4cfc-9f6d-3e8913c39555-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-5b7dbd08-388d-4ee8-935a-f0e317867f83-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-5b7dbd08-388d-4ee8-935a-f0e317867f83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-e88ee376-db64-48ad-8865-cc9063032e94" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-e88ee376-db64-48ad-8865-cc9063032e94" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-5b7dbd08-388d-4ee8-935a-f0e317867f83" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-5b7dbd08-388d-4ee8-935a-f0e317867f83" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] Deleting offline snapshot 5b7dbd08-388d-4ee8-935a-f0e317867f83 of volume e88ee376-db64-48ad-8865-cc9063032e94 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:38:23 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] snapshot_file for this snap is: volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:38:23 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[efde7974-0f23-4249-9daa-115bce62cc12]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:23 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83 Sep 10 18:38:23 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:24 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83" returned: 0 in 0.458s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:24 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e88ee376-db64-48ad-8865-cc9063032e94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:38:24 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3d504b-e555-45e7-be2b-6388626af3b7]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:24 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94 Sep 10 18:38:24 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:24 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94" returned: 0 in 0.521s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:24 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:24 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83 Sep 10 18:38:24 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:25 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83" returned: 0 in 0.473s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:25 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83 Sep 10 18:38:25 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:25 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94.5b7dbd08-388d-4ee8-935a-f0e317867f83" returned: 0 in 0.270s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-5b7dbd08-388d-4ee8-935a-f0e317867f83" released by "_delete_snapshot" :: held 1.875s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-e88ee376-db64-48ad-8865-cc9063032e94" released by "delete_snapshot" :: held 1.916s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:25 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] Created reservations ['305cbb84-11f6-4383-a8ef-d15a464fe41f', 'add6fe46-18f5-4b8b-99a5-f95c4798a6cb', 'b6f3b5f5-cad4-46c0-a438-9fc339f5b320', 'b4ccf264-2b62-4020-b2d2-e4cfa22311e7'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:25 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] Delete snapshot completed successfully. Sep 10 18:38:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-dd7d9e4a-a9ba-49e7-ae58-686c27707834 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-5b7dbd08-388d-4ee8-935a-f0e317867f83-delete_snapshot" released by "delete_snapshot" :: held 2.077s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-e88ee376-db64-48ad-8865-cc9063032e94-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] Lock "cinder-e88ee376-db64-48ad-8865-cc9063032e94-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-e88ee376-db64-48ad-8865-cc9063032e94" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:25 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-e88ee376-db64-48ad-8865-cc9063032e94" acquired by "delete_volume" :: waited 0.027s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:25 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe8764c-518c-47bc-a0c6-7ceaf537643b]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:25 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:25 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94 Sep 10 18:38:25 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:26 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94" returned: 0 in 0.429s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:26 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94 Sep 10 18:38:26 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:26 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e88ee376-db64-48ad-8865-cc9063032e94" returned: 0 in 0.351s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:26 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-e88ee376-db64-48ad-8865-cc9063032e94" released by "delete_volume" :: held 0.856s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:26 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] Created reservations ['4535023e-853f-44fd-89a2-42f8125d2ae4', '73e0fccc-1d0c-45db-abde-529db4a52d33', 'f0b9ced3-4c2c-4897-9515-29e096fc006d', '9a6e1f0b-44dc-4bd8-893e-a3bb7e8880f9'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:26 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:26 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:26 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:26 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:26 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:27 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.484s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:27 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] Deleted volume successfully. Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5f6d6a6b-7f4d-486d-b74e-75671e140c4c tempest-ProjectMemberTests-1340142452 None] Lock "cinder-e88ee376-db64-48ad-8865-cc9063032e94-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Flow 'volume_create_manager' (295a3aff-5324-4537-908b-dee77717bc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8583fd16-aa6d-4384-8570-775d76222a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8583fd16-aa6d-4384-8570-775d76222a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-975358531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2f5cbb-618c-4f40-afac-fcbd051e9aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6ceb3234b46a4b8cb6b06de47d03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:28Z,use_quota=True,user_id='651651ec609e4eeda1eecd55281a7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4a915c-8d1d-4831-86cb-3ac98bb13288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4a915c-8d1d-4831-86cb-3ac98bb13288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9165e841-bd0e-485d-aa72-9bb56365c67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9165e841-bd0e-485d-aa72-9bb56365c67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a2f5cbb-618c-4f40-afac-fcbd051e9aa7', 'volume_name': 'volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f294c19-3964-4d79-b7d9-c3ea182a5b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f294c19-3964-4d79-b7d9-c3ea182a5b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15352ab-9528-464e-8ec8-ca32207ae332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:27 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Volume 1a2f5cbb-618c-4f40-afac-fcbd051e9aa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7', 'volume_size': 1} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-975358531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2f5cbb-618c-4f40-afac-fcbd051e9aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6ceb3234b46a4b8cb6b06de47d03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:28Z,use_quota=True,user_id='651651ec609e4eeda1eecd55281a7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Creating volume 1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:38:27 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:38:27 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:27 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 1073741824 Sep 10 18:38:27 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:28 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 1073741824" returned: 0 in 0.505s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:28 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 Sep 10 18:38:28 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:28 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7" returned: 0 in 0.287s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:28 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:38:28 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15352ab-9528-464e-8ec8-ca32207ae332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb4267e-f686-41d8-9590-87867514018a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:28 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Volume volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 (1a2f5cbb-618c-4f40-afac-fcbd051e9aa7): created successfully Sep 10 18:38:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb4267e-f686-41d8-9590-87867514018a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:28 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Flow 'volume_create_manager' (295a3aff-5324-4537-908b-dee77717bc25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:28 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-9b24e4a1-62dc-4284-83fb-9f812a3cc52a tempest-ProjectMemberTests-1340142452 None] Created volume successfully. Sep 10 18:38:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:38:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:29 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:29 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:29 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.334s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:38:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 28 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:38:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:38:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b2af8cd1-57f2-41cd-812e-c6bf0bd8a5e9 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b2af8cd1-57f2-41cd-812e-c6bf0bd8a5e9 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-b2af8cd1-57f2-41cd-812e-c6bf0bd8a5e9 tempest-ProjectMemberTests-1340142452 None] Creating offline snapshot b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d of volume 1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:38:29 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b781901-e541-43f5-8650-aa7c48cb3881]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2af8cd1-57f2-41cd-812e-c6bf0bd8a5e9 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:30 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 Sep 10 18:38:30 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:30 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2af8cd1-57f2-41cd-812e-c6bf0bd8a5e9 tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7" returned: 0 in 0.444s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2af8cd1-57f2-41cd-812e-c6bf0bd8a5e9 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:30 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d 1G Sep 10 18:38:30 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:30 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2af8cd1-57f2-41cd-812e-c6bf0bd8a5e9 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d 1G" returned: 0 in 0.486s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:30 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2af8cd1-57f2-41cd-812e-c6bf0bd8a5e9 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:30 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d Sep 10 18:38:30 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:31 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2af8cd1-57f2-41cd-812e-c6bf0bd8a5e9 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d" returned: 0 in 0.356s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:31 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-b2af8cd1-57f2-41cd-812e-c6bf0bd8a5e9 tempest-ProjectMemberTests-1340142452 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d is being set with open permissions: ugo+rw Sep 10 18:38:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2af8cd1-57f2-41cd-812e-c6bf0bd8a5e9 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:31 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d Sep 10 18:38:31 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:31 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2af8cd1-57f2-41cd-812e-c6bf0bd8a5e9 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d" returned: 0 in 0.332s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2af8cd1-57f2-41cd-812e-c6bf0bd8a5e9 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:31 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.info Sep 10 18:38:31 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:31 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2af8cd1-57f2-41cd-812e-c6bf0bd8a5e9 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.info" returned: 0 in 0.286s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:31 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-b2af8cd1-57f2-41cd-812e-c6bf0bd8a5e9 tempest-ProjectMemberTests-1340142452 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.info is being set with open permissions: ugo+rw Sep 10 18:38:31 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2af8cd1-57f2-41cd-812e-c6bf0bd8a5e9 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:31 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.info Sep 10 18:38:31 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:32 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2af8cd1-57f2-41cd-812e-c6bf0bd8a5e9 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.info" returned: 0 in 0.283s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:32 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b2af8cd1-57f2-41cd-812e-c6bf0bd8a5e9 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.276s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:32 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-b2af8cd1-57f2-41cd-812e-c6bf0bd8a5e9 tempest-ProjectMemberTests-1340142452 None] Create snapshot completed successfully Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] Deleting offline snapshot b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d of volume 1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] snapshot_file for this snap is: volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad3ea91-3488-4c53-811d-09d9e405df59]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:33 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d Sep 10 18:38:33 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:33 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d" returned: 0 in 0.462s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db0572b-6128-47bf-87d9-9ae3b0732c25]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=249,cinder:UPDATE=331,cinder:DELETE=28,cinder:INSERT=93 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Flow 'volume_create_manager' (8186f759-a005-450b-b6e0-cfff192a7ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b1fad8-1f0a-4378-8101-f3a32e21c117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:33 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 Sep 10 18:38:33 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b1fad8-1f0a-4378-8101-f3a32e21c117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1460564249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9257f34-74ff-4cf3-9eba-71134d6aa75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a70d887ae1054c498c5ecfe7d64af23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:34Z,use_quota=True,user_id='20c569b28e764336b08fa2022c80a295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e15268-0863-4d90-9d81-de247d11db77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e15268-0863-4d90-9d81-de247d11db77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb022968-b953-4009-8f9c-edcfeedd1477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb022968-b953-4009-8f9c-edcfeedd1477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9257f34-74ff-4cf3-9eba-71134d6aa75c', 'volume_name': 'volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4047c60-f126-4c9b-8de7-b214e861f2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4047c60-f126-4c9b-8de7-b214e861f2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (910e8184-0709-4106-9b61-4efadf4a7606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:33 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Volume b9257f34-74ff-4cf3-9eba-71134d6aa75c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c', 'volume_size': 1} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1460564249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9257f34-74ff-4cf3-9eba-71134d6aa75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a70d887ae1054c498c5ecfe7d64af23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:34Z,use_quota=True,user_id='20c569b28e764336b08fa2022c80a295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Creating volume b9257f34-74ff-4cf3-9eba-71134d6aa75c {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:38:33 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:38:33 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:33 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c 1073741824 Sep 10 18:38:33 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:34 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7" returned: 0 in 0.505s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:34 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d Sep 10 18:38:34 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:34 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c 1073741824" returned: 0 in 0.638s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:34 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c Sep 10 18:38:34 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:34 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d" returned: 0 in 0.510s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:34 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d Sep 10 18:38:34 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:34 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c" returned: 0 in 0.268s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:34 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:38:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (910e8184-0709-4106-9b61-4efadf4a7606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed71b58-b9cf-4383-9235-e6a2acea6a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:34 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Volume volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c (b9257f34-74ff-4cf3-9eba-71134d6aa75c): created successfully Sep 10 18:38:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed71b58-b9cf-4383-9235-e6a2acea6a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:34 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Flow 'volume_create_manager' (8186f759-a005-450b-b6e0-cfff192a7ec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:34 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-1cdb10b7-f096-4983-9f52-9a31f9234602 tempest-ProjectReaderTests-2023450681 None] Created volume successfully. Sep 10 18:38:34 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:34 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7.b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d" returned: 0 in 0.285s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d" released by "_delete_snapshot" :: held 1.906s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7" released by "delete_snapshot" :: held 1.936s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:35 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] Created reservations ['7941e815-774d-4122-93fe-fc71020c5b19', 'e2a15cb2-a12a-4ed0-9a8b-9f1709adcd62', '1ccced07-daba-4cbe-86bc-4a45dbac3e68', '52fa8571-40ea-4108-b1c4-b9bebae5dcac'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:35 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] Delete snapshot completed successfully. Sep 10 18:38:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-90797d1b-2bbb-4215-b85f-428c6a72f9a8 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-b3c0071a-4106-4ebe-bb6d-4ce1a10ad87d-delete_snapshot" released by "delete_snapshot" :: held 2.096s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:35 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7" acquired by "delete_volume" :: waited 0.032s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:35 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b12efa-2ab0-4e5e-96df-8847ee308f07]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:35 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 Sep 10 18:38:35 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:35 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7" returned: 0 in 0.385s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:35 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:35 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7 Sep 10 18:38:35 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-29bfb796-344b-4704-8970-84aa1344900a tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-29bfb796-344b-4704-8970-84aa1344900a tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-29bfb796-344b-4704-8970-84aa1344900a tempest-ProjectReaderTests-2023450681 None] Creating offline snapshot 963d417b-f278-42d3-8190-fc03755db7a6 of volume b9257f34-74ff-4cf3-9eba-71134d6aa75c {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:38:36 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d108f1e9-5084-49af-85da-954a04d3b88a]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-29bfb796-344b-4704-8970-84aa1344900a tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:36 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7" returned: 0 in 0.329s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7" released by "delete_volume" :: held 0.820s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:36 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] Created reservations ['1c2e6aec-5f5c-4ece-a357-a15348eef895', 'ad8f8a15-e9e1-4390-9b9f-d34870960bea', '5f5ce883-1f98-4cab-be98-bf382be5e4df', 'c8442f99-4326-4995-a7c0-9933c99e355d'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:36 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c Sep 10 18:38:36 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:36 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:36 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:36 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:36 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-29bfb796-344b-4704-8970-84aa1344900a tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c" returned: 0 in 0.575s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-29bfb796-344b-4704-8970-84aa1344900a tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:36 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:36 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.386s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:36 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:36 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] Deleted volume successfully. Sep 10 18:38:36 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6 1G Sep 10 18:38:36 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:36 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c5d83bc4-5fd6-4703-a3c6-bf6f511ad5b2 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-1a2f5cbb-618c-4f40-afac-fcbd051e9aa7-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:37 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:38:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Flow 'volume_create_manager' (325042f1-f6c7-4f52-8922-560058fb96c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97527c4b-2f34-4dab-ae72-8893a9a3f13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97527c4b-2f34-4dab-ae72-8893a9a3f13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1246139776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf846d4-f2df-4d47-ab41-51dfeb474d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6ceb3234b46a4b8cb6b06de47d03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:37Z,use_quota=True,user_id='651651ec609e4eeda1eecd55281a7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f2d950-9cb7-48ff-b930-5561ee30de3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f2d950-9cb7-48ff-b930-5561ee30de3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a5d0240-3542-423e-9878-cb3c502f3ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a5d0240-3542-423e-9878-cb3c502f3ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bf846d4-f2df-4d47-ab41-51dfeb474d5f', 'volume_name': 'volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9be16a2-2f4d-4210-b30b-ad225484a280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9be16a2-2f4d-4210-b30b-ad225484a280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:37 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18ac199-9488-42c6-bd3a-2da71e9ab336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:37 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Volume 4bf846d4-f2df-4d47-ab41-51dfeb474d5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f', 'volume_size': 1} Sep 10 18:38:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:37 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-29bfb796-344b-4704-8970-84aa1344900a tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6 1G" returned: 0 in 0.692s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-29bfb796-344b-4704-8970-84aa1344900a tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:37 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6 Sep 10 18:38:37 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:37 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-29bfb796-344b-4704-8970-84aa1344900a tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6" returned: 0 in 0.340s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:37 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-29bfb796-344b-4704-8970-84aa1344900a tempest-ProjectReaderTests-2023450681 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6 is being set with open permissions: ugo+rw Sep 10 18:38:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-29bfb796-344b-4704-8970-84aa1344900a tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:37 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6 Sep 10 18:38:37 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:37 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:37 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-29bfb796-344b-4704-8970-84aa1344900a tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6" returned: 0 in 0.251s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-29bfb796-344b-4704-8970-84aa1344900a tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:38 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.info Sep 10 18:38:38 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:38 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-29bfb796-344b-4704-8970-84aa1344900a tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.info" returned: 0 in 0.277s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:38 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-29bfb796-344b-4704-8970-84aa1344900a tempest-ProjectReaderTests-2023450681 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.info is being set with open permissions: ugo+rw Sep 10 18:38:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-29bfb796-344b-4704-8970-84aa1344900a tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:38 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.info Sep 10 18:38:38 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:38 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-29bfb796-344b-4704-8970-84aa1344900a tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.info" returned: 0 in 0.246s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-29bfb796-344b-4704-8970-84aa1344900a tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.474s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.330s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1246139776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf846d4-f2df-4d47-ab41-51dfeb474d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6ceb3234b46a4b8cb6b06de47d03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:37Z,use_quota=True,user_id='651651ec609e4eeda1eecd55281a7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:38:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Creating volume 4bf846d4-f2df-4d47-ab41-51dfeb474d5f {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:38:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:38 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:38:38 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:38:38 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:38 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f 1073741824 Sep 10 18:38:38 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:38 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-29bfb796-344b-4704-8970-84aa1344900a tempest-ProjectReaderTests-2023450681 None] Create snapshot completed successfully Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:38:39 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Flow 'volume_create_manager' (58ae7162-23a1-4445-8c2c-8b89e395b8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff66bc2d-29cd-4f81-9b8d-8a02a5729123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f 1073741824" returned: 0 in 0.580s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff66bc2d-29cd-4f81-9b8d-8a02a5729123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760877771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4d6d94-7863-4812-9925-a34c61f96be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8edfc9c7984231b40388aa90c2e940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:39Z,use_quota=True,user_id='4c94fcad4b734a74bae5ec81a03389d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e292a8-da7f-4939-8f2d-d90784ef3fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e292a8-da7f-4939-8f2d-d90784ef3fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca620b3-153f-485b-937b-6952d9e9a42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca620b3-153f-485b-937b-6952d9e9a42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd4d6d94-7863-4812-9925-a34c61f96be0', 'volume_name': 'volume-dd4d6d94-7863-4812-9925-a34c61f96be0', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcef814c-fc00-40f0-ab1f-4065c87b58d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcef814c-fc00-40f0-ab1f-4065c87b58d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e717ecc6-b7f0-4f47-a454-7169d0c7d27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:39 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Volume dd4d6d94-7863-4812-9925-a34c61f96be0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd4d6d94-7863-4812-9925-a34c61f96be0', 'volume_size': 1} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:39 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f Sep 10 18:38:39 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-963d417b-f278-42d3-8190-fc03755db7a6-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] Lock "cinder-963d417b-f278-42d3-8190-fc03755db7a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-quobyte-b9257f34-74ff-4cf3-9eba-71134d6aa75c" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-b9257f34-74ff-4cf3-9eba-71134d6aa75c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-quobyte-963d417b-f278-42d3-8190-fc03755db7a6" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-963d417b-f278-42d3-8190-fc03755db7a6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] Deleting offline snapshot 963d417b-f278-42d3-8190-fc03755db7a6 of volume b9257f34-74ff-4cf3-9eba-71134d6aa75c {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] snapshot_file for this snap is: volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eeea6a1-5c0b-4ad7-ac05-d154e2c4a56b]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:39 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f" returned: 0 in 0.331s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.367s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760877771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4d6d94-7863-4812-9925-a34c61f96be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8edfc9c7984231b40388aa90c2e940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:39Z,use_quota=True,user_id='4c94fcad4b734a74bae5ec81a03389d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Creating volume dd4d6d94-7863-4812-9925-a34c61f96be0 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:38:39 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dd4d6d94-7863-4812-9925-a34c61f96be0 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18ac199-9488-42c6-bd3a-2da71e9ab336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:39 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dd4d6d94-7863-4812-9925-a34c61f96be0 1073741824 Sep 10 18:38:39 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f774dfd6-6bda-4b4a-a147-28ea39d4c980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:39 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Volume volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f (4bf846d4-f2df-4d47-ab41-51dfeb474d5f): created successfully Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f774dfd6-6bda-4b4a-a147-28ea39d4c980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Flow 'volume_create_manager' (325042f1-f6c7-4f52-8922-560058fb96c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:39 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6 Sep 10 18:38:39 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:39 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-64a223bc-2616-4309-87f1-e066941aab09 tempest-ProjectMemberTests-1340142452 None] Created volume successfully. Sep 10 18:38:39 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6" returned: 0 in 0.412s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f00e07d-b1f6-48b8-95b0-471f2a5ebb83]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:39 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:40 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dd4d6d94-7863-4812-9925-a34c61f96be0 1073741824" returned: 0 in 0.493s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:40 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c Sep 10 18:38:40 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dd4d6d94-7863-4812-9925-a34c61f96be0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:40 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dd4d6d94-7863-4812-9925-a34c61f96be0 Sep 10 18:38:40 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:40 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dd4d6d94-7863-4812-9925-a34c61f96be0" returned: 0 in 0.270s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:40 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c" returned: 0 in 0.424s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e717ecc6-b7f0-4f47-a454-7169d0c7d27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd4d6d94-7863-4812-9925-a34c61f96be0', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6d2780-8a57-44cc-9cab-71c5f2642bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:40 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6 Sep 10 18:38:40 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-eb9b10c7-c7f0-4a71-9b30-7818083628db tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-eb9b10c7-c7f0-4a71-9b30-7818083628db tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:40 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Volume volume-dd4d6d94-7863-4812-9925-a34c61f96be0 (dd4d6d94-7863-4812-9925-a34c61f96be0): created successfully Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6d2780-8a57-44cc-9cab-71c5f2642bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Flow 'volume_create_manager' (58ae7162-23a1-4445-8c2c-8b89e395b8e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-eb9b10c7-c7f0-4a71-9b30-7818083628db tempest-ProjectMemberTests-1340142452 None] Creating offline snapshot 906fc658-2824-4c44-8337-34f724f86755 of volume 4bf846d4-f2df-4d47-ab41-51dfeb474d5f {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:38:40 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-24237126-7e3d-4099-8814-ae30665fa75e tempest-ProjectReaderTests-1191578828 None] Created volume successfully. Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e58a7e-9903-4f4d-8f87-fdfbe253f189]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eb9b10c7-c7f0-4a71-9b30-7818083628db tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:40 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f Sep 10 18:38:40 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:40 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6" returned: 0 in 0.337s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:40 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6 Sep 10 18:38:40 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:40 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eb9b10c7-c7f0-4a71-9b30-7818083628db tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f" returned: 0 in 0.368s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eb9b10c7-c7f0-4a71-9b30-7818083628db tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:40 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755 1G Sep 10 18:38:40 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:40 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:40 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c.963d417b-f278-42d3-8190-fc03755db7a6" returned: 0 in 0.258s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-963d417b-f278-42d3-8190-fc03755db7a6" released by "_delete_snapshot" :: held 1.568s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-b9257f34-74ff-4cf3-9eba-71134d6aa75c" released by "delete_snapshot" :: held 1.601s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] Created reservations ['f7d553e8-3705-44f8-9dbd-5e2c50097896', '63b16e27-696e-4990-91de-9629dd119748', '6882d9b0-3693-47db-b4df-b1109dd8d6f0', '65984b3a-0330-4deb-96b1-1bfec997a4e6'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:41 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] Delete snapshot completed successfully. Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4547e7e2-9aad-4b4d-b078-c1980f9c438c tempest-ProjectReaderTests-2023450681 None] Lock "cinder-963d417b-f278-42d3-8190-fc03755db7a6-delete_snapshot" released by "delete_snapshot" :: held 1.807s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:41 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] Acquiring lock "cinder-dd4d6d94-7863-4812-9925-a34c61f96be0-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eb9b10c7-c7f0-4a71-9b30-7818083628db tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755 1G" returned: 0 in 0.479s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eb9b10c7-c7f0-4a71-9b30-7818083628db tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] Lock "cinder-dd4d6d94-7863-4812-9925-a34c61f96be0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:41 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755 Sep 10 18:38:41 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] Acquiring lock "cinder-quobyte-dd4d6d94-7863-4812-9925-a34c61f96be0" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] Lock "cinder-quobyte-dd4d6d94-7863-4812-9925-a34c61f96be0" acquired by "delete_volume" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1a18b6-d44c-4ba6-95bf-bb81a877907e]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dd4d6d94-7863-4812-9925-a34c61f96be0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-b9257f34-74ff-4cf3-9eba-71134d6aa75c-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:41 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dd4d6d94-7863-4812-9925-a34c61f96be0 Sep 10 18:38:41 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] Lock "cinder-b9257f34-74ff-4cf3-9eba-71134d6aa75c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-quobyte-b9257f34-74ff-4cf3-9eba-71134d6aa75c" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-b9257f34-74ff-4cf3-9eba-71134d6aa75c" acquired by "delete_volume" :: waited 0.030s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c88e638-f8ac-4451-921e-9b324798b92a]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:41 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eb9b10c7-c7f0-4a71-9b30-7818083628db tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755" returned: 0 in 0.401s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:41 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-eb9b10c7-c7f0-4a71-9b30-7818083628db tempest-ProjectMemberTests-1340142452 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755 is being set with open permissions: ugo+rw Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eb9b10c7-c7f0-4a71-9b30-7818083628db tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:41 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755 Sep 10 18:38:41 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:41 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c Sep 10 18:38:41 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:41 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dd4d6d94-7863-4812-9925-a34c61f96be0" returned: 0 in 0.488s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:41 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dd4d6d94-7863-4812-9925-a34c61f96be0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:41 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dd4d6d94-7863-4812-9925-a34c61f96be0 Sep 10 18:38:41 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:42 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eb9b10c7-c7f0-4a71-9b30-7818083628db tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755" returned: 0 in 0.333s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eb9b10c7-c7f0-4a71-9b30-7818083628db tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:42 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.info Sep 10 18:38:42 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:42 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c" returned: 0 in 0.454s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:42 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c Sep 10 18:38:42 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:42 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-dd4d6d94-7863-4812-9925-a34c61f96be0" returned: 0 in 0.284s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] Lock "cinder-quobyte-dd4d6d94-7863-4812-9925-a34c61f96be0" released by "delete_volume" :: held 0.812s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] Created reservations ['91b48f40-ee97-4a7a-8754-14c629a8569c', 'a501602c-789e-4d8d-827e-7e5ee62777c4', '4a772856-b8d7-4044-9932-fdf60d5a9144', '11fdef18-a78c-404c-a8b6-f7c2a275ad64'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:42 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eb9b10c7-c7f0-4a71-9b30-7818083628db tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.info" returned: 0 in 0.290s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:42 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-eb9b10c7-c7f0-4a71-9b30-7818083628db tempest-ProjectMemberTests-1340142452 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.info is being set with open permissions: ugo+rw Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eb9b10c7-c7f0-4a71-9b30-7818083628db tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:42 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:42 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:42 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.info Sep 10 18:38:42 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:42 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-b9257f34-74ff-4cf3-9eba-71134d6aa75c" returned: 0 in 0.319s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-b9257f34-74ff-4cf3-9eba-71134d6aa75c" released by "delete_volume" :: held 0.835s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] Created reservations ['dee1a798-be43-4fde-b221-dc1ba835bfad', 'b2e9d1d9-b04a-483e-a442-b357a00b77d9', '9e17dae0-9f65-4f7b-abe3-e051d9e50f1f', '71af5771-2b59-4460-b0f9-68ebe32ba1c7'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:42 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:42 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.302s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:42 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] Deleted volume successfully. Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eb9b10c7-c7f0-4a71-9b30-7818083628db tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.info" returned: 0 in 0.306s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:42 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:42 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-eb9b10c7-c7f0-4a71-9b30-7818083628db tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.284s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d674c289-b6ad-4b64-a916-a6a78261a38d tempest-ProjectReaderTests-1191578828 None] Lock "cinder-dd4d6d94-7863-4812-9925-a34c61f96be0-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:42 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-eb9b10c7-c7f0-4a71-9b30-7818083628db tempest-ProjectMemberTests-1340142452 None] Create snapshot completed successfully Sep 10 18:38:42 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.298s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:42 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] Deleted volume successfully. Sep 10 18:38:42 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-970ee4d4-ba6e-47f3-a9ba-002596aae15d tempest-ProjectReaderTests-2023450681 None] Lock "cinder-b9257f34-74ff-4cf3-9eba-71134d6aa75c-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Flow 'volume_create_manager' (c2da6463-cb15-481c-a2ce-3f2ad8986f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9de3919-4ac4-4b35-bbf3-197b04ef67f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9de3919-4ac4-4b35-bbf3-197b04ef67f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1627520012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f418758d-e9bc-40d5-b10d-44887f8fa891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8edfc9c7984231b40388aa90c2e940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:43Z,use_quota=True,user_id='4c94fcad4b734a74bae5ec81a03389d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53802762-1f3d-4836-b4c6-1a5a5807f6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53802762-1f3d-4836-b4c6-1a5a5807f6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e638127-8423-4a78-b391-c85dfa8301e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e638127-8423-4a78-b391-c85dfa8301e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f418758d-e9bc-40d5-b10d-44887f8fa891', 'volume_name': 'volume-f418758d-e9bc-40d5-b10d-44887f8fa891', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4ddce6-a67e-4482-81fd-fc3f9eeebaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4ddce6-a67e-4482-81fd-fc3f9eeebaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8c71fa-2d90-48d8-88b2-771a2cc8a5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:43 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Volume f418758d-e9bc-40d5-b10d-44887f8fa891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f418758d-e9bc-40d5-b10d-44887f8fa891', 'volume_size': 1} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1627520012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f418758d-e9bc-40d5-b10d-44887f8fa891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8edfc9c7984231b40388aa90c2e940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:43Z,use_quota=True,user_id='4c94fcad4b734a74bae5ec81a03389d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Creating volume f418758d-e9bc-40d5-b10d-44887f8fa891 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:38:43 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f418758d-e9bc-40d5-b10d-44887f8fa891 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:43 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f418758d-e9bc-40d5-b10d-44887f8fa891 1073741824 Sep 10 18:38:43 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Flow 'volume_create_manager' (0c2363b1-f4c5-40b2-9062-406431492724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31cb2df-3a9a-4cf1-81b9-eb0bc0417ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31cb2df-3a9a-4cf1-81b9-eb0bc0417ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-726860854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c922aec-8667-4bb4-91cd-60254a41dc89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a70d887ae1054c498c5ecfe7d64af23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:43Z,use_quota=True,user_id='20c569b28e764336b08fa2022c80a295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce7fecb-7f08-4d41-810c-9bccbd6d1e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce7fecb-7f08-4d41-810c-9bccbd6d1e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71082390-b5cc-44e9-9d15-a751e52800c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71082390-b5cc-44e9-9d15-a751e52800c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c922aec-8667-4bb4-91cd-60254a41dc89', 'volume_name': 'volume-3c922aec-8667-4bb4-91cd-60254a41dc89', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb6f9a9-1084-4b25-9530-aca059149135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb6f9a9-1084-4b25-9530-aca059149135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b5b21c-e39b-40cd-aa11-20d13d36767f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:43 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Volume 3c922aec-8667-4bb4-91cd-60254a41dc89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c922aec-8667-4bb4-91cd-60254a41dc89', 'volume_size': 1} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-906fc658-2824-4c44-8337-34f724f86755-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] Lock "cinder-906fc658-2824-4c44-8337-34f724f86755-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-4bf846d4-f2df-4d47-ab41-51dfeb474d5f" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-4bf846d4-f2df-4d47-ab41-51dfeb474d5f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-906fc658-2824-4c44-8337-34f724f86755" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-906fc658-2824-4c44-8337-34f724f86755" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] Deleting offline snapshot 906fc658-2824-4c44-8337-34f724f86755 of volume 4bf846d4-f2df-4d47-ab41-51dfeb474d5f {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] snapshot_file for this snap is: volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[363b3273-b999-4353-9477-0562ad0d971e]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:43 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f418758d-e9bc-40d5-b10d-44887f8fa891 1073741824" returned: 0 in 0.554s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:43 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f418758d-e9bc-40d5-b10d-44887f8fa891 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:43 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f418758d-e9bc-40d5-b10d-44887f8fa891 Sep 10 18:38:43 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:43 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755 Sep 10 18:38:43 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:44 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f418758d-e9bc-40d5-b10d-44887f8fa891" returned: 0 in 0.270s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.586s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-726860854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c922aec-8667-4bb4-91cd-60254a41dc89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a70d887ae1054c498c5ecfe7d64af23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:43Z,use_quota=True,user_id='20c569b28e764336b08fa2022c80a295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Creating volume 3c922aec-8667-4bb4-91cd-60254a41dc89 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:38:44 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8c71fa-2d90-48d8-88b2-771a2cc8a5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f418758d-e9bc-40d5-b10d-44887f8fa891', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:44 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:44 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89 1073741824 Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0763daee-e8d5-4758-8448-a200104f4c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:44 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755" returned: 0 in 0.408s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:38:44 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Volume volume-f418758d-e9bc-40d5-b10d-44887f8fa891 (f418758d-e9bc-40d5-b10d-44887f8fa891): created successfully Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0763daee-e8d5-4758-8448-a200104f4c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Flow 'volume_create_manager' (c2da6463-cb15-481c-a2ce-3f2ad8986f45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3482e82-6a7c-4f36-9a6a-5c2522ae2eb0]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:44 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-167c5cd0-802a-4f02-b639-e6bdceea731e tempest-ProjectReaderTests-1191578828 None] Created volume successfully. Sep 10 18:38:44 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f Sep 10 18:38:44 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:44 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89 1073741824" returned: 0 in 0.493s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:44 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f" returned: 0 in 0.421s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:44 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755 Sep 10 18:38:44 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:44 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89 Sep 10 18:38:44 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:44 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89" returned: 0 in 0.281s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b5b21c-e39b-40cd-aa11-20d13d36767f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c922aec-8667-4bb4-91cd-60254a41dc89', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a2a261-2e02-473a-aac3-6b2794578b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:44 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Volume volume-3c922aec-8667-4bb4-91cd-60254a41dc89 (3c922aec-8667-4bb4-91cd-60254a41dc89): created successfully Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a2a261-2e02-473a-aac3-6b2794578b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:44 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Flow 'volume_create_manager' (0c2363b1-f4c5-40b2-9062-406431492724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:45 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-0107f07e-2352-4e97-a026-828d8f89fd01 tempest-ProjectReaderTests-2023450681 None] Created volume successfully. Sep 10 18:38:45 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755" returned: 0 in 0.402s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:45 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755 Sep 10 18:38:45 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] Acquiring lock "cinder-f418758d-e9bc-40d5-b10d-44887f8fa891-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] Lock "cinder-f418758d-e9bc-40d5-b10d-44887f8fa891-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] Acquiring lock "cinder-quobyte-f418758d-e9bc-40d5-b10d-44887f8fa891" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] Lock "cinder-quobyte-f418758d-e9bc-40d5-b10d-44887f8fa891" acquired by "delete_volume" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4664fc1c-abba-4d50-9ba6-d0751a45e03c]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f418758d-e9bc-40d5-b10d-44887f8fa891 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:45 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f.906fc658-2824-4c44-8337-34f724f86755" returned: 0 in 0.301s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-906fc658-2824-4c44-8337-34f724f86755" released by "_delete_snapshot" :: held 1.656s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-4bf846d4-f2df-4d47-ab41-51dfeb474d5f" released by "delete_snapshot" :: held 1.678s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:45 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f418758d-e9bc-40d5-b10d-44887f8fa891 Sep 10 18:38:45 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] Created reservations ['37709158-0de7-440d-8fa6-aa8852549d9b', '0791f774-ba85-4eaa-bde7-339f16a9bcbd', '447c2147-eee9-4905-9a19-e69e119c5a13', 'a4e881b1-5bb8-4ced-9dc8-65f92af10e36'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:45 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] Delete snapshot completed successfully. Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f129ff0a-0f46-46ae-a9f2-21cd5fbd000d tempest-ProjectMemberTests-1340142452 None] Lock "cinder-906fc658-2824-4c44-8337-34f724f86755-delete_snapshot" released by "delete_snapshot" :: held 1.852s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:45 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f418758d-e9bc-40d5-b10d-44887f8fa891" returned: 0 in 0.412s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f418758d-e9bc-40d5-b10d-44887f8fa891 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:45 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f418758d-e9bc-40d5-b10d-44887f8fa891 Sep 10 18:38:45 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f24a801b-8ca4-4e05-b36a-c1b12c7c68d0 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f24a801b-8ca4-4e05-b36a-c1b12c7c68d0 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-f24a801b-8ca4-4e05-b36a-c1b12c7c68d0 tempest-ProjectReaderTests-2023450681 None] Creating offline snapshot 897b018d-4ba0-4a0e-a3ca-6e030ada041b of volume 3c922aec-8667-4bb4-91cd-60254a41dc89 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f1b937-4a88-4e38-b25c-b86ffcccabcf]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f24a801b-8ca4-4e05-b36a-c1b12c7c68d0 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-4bf846d4-f2df-4d47-ab41-51dfeb474d5f-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-4bf846d4-f2df-4d47-ab41-51dfeb474d5f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:45 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89 Sep 10 18:38:45 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-4bf846d4-f2df-4d47-ab41-51dfeb474d5f" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-4bf846d4-f2df-4d47-ab41-51dfeb474d5f" acquired by "delete_volume" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7890d1-b96d-4dc2-8910-9b5b242a8e8b]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:45 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:46 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f418758d-e9bc-40d5-b10d-44887f8fa891" returned: 0 in 0.333s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] Lock "cinder-quobyte-f418758d-e9bc-40d5-b10d-44887f8fa891" released by "delete_volume" :: held 0.800s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:46 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f Sep 10 18:38:46 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] Created reservations ['5b590848-fd5a-403f-baed-5bbdfacb08eb', 'cd40c019-3143-494c-be7b-7e151ecafe29', 'a974331d-4ab2-4d19-911b-4eac6676d41f', 'c6f9084b-2936-4bee-ba3b-89379c8e1b58'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:46 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f24a801b-8ca4-4e05-b36a-c1b12c7c68d0 tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89" returned: 0 in 0.455s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f24a801b-8ca4-4e05-b36a-c1b12c7c68d0 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:46 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b 1G Sep 10 18:38:46 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:46 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:46 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:46 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f" returned: 0 in 0.524s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:46 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.313s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:46 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] Deleted volume successfully. Sep 10 18:38:46 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f Sep 10 18:38:46 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4ac327e4-ab7c-4f00-9746-5d2d9f452084 tempest-ProjectReaderTests-1191578828 None] Lock "cinder-f418758d-e9bc-40d5-b10d-44887f8fa891-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:46 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f24a801b-8ca4-4e05-b36a-c1b12c7c68d0 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b 1G" returned: 0 in 0.586s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f24a801b-8ca4-4e05-b36a-c1b12c7c68d0 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c922aec-8667-4bb4-91cd-60254a41dc89 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:46 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c922aec-8667-4bb4-91cd-60254a41dc89 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b Sep 10 18:38:46 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:46 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-4bf846d4-f2df-4d47-ab41-51dfeb474d5f" returned: 0 in 0.317s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-4bf846d4-f2df-4d47-ab41-51dfeb474d5f" released by "delete_volume" :: held 0.923s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:46 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] Created reservations ['bf4fc0d6-1ec0-4b90-8d8c-b6519894e035', '06166142-61c6-42dd-8662-919b1c38250c', '58641e9e-5a4f-49b0-8ff3-1836fc272ea7', 'f2918820-4bda-4bba-bf4d-2aa7efba3209'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:47 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:47 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:47 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f24a801b-8ca4-4e05-b36a-c1b12c7c68d0 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c922aec-8667-4bb4-91cd-60254a41dc89 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b" returned: 0 in 0.374s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:47 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-f24a801b-8ca4-4e05-b36a-c1b12c7c68d0 tempest-ProjectReaderTests-2023450681 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b is being set with open permissions: ugo+rw Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f24a801b-8ca4-4e05-b36a-c1b12c7c68d0 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:47 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b Sep 10 18:38:47 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:47 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.441s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:47 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] Deleted volume successfully. Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-f681dc05-4ed4-4289-968c-f3089dd453f6 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-4bf846d4-f2df-4d47-ab41-51dfeb474d5f-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:47 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f24a801b-8ca4-4e05-b36a-c1b12c7c68d0 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b" returned: 0 in 0.399s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f24a801b-8ca4-4e05-b36a-c1b12c7c68d0 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:47 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.info Sep 10 18:38:47 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Flow 'volume_create_manager' (5aa2182e-fde4-4bb8-8f7b-cc8d0da1b151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db802641-f8ac-4a66-93d5-7b0ef51802a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db802641-f8ac-4a66-93d5-7b0ef51802a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1612755096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f99a3c-0cc0-4842-94ec-f95cb25eecf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6ceb3234b46a4b8cb6b06de47d03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:48Z,use_quota=True,user_id='651651ec609e4eeda1eecd55281a7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a14e277-ae64-44e7-8c52-1585a07fc9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a14e277-ae64-44e7-8c52-1585a07fc9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9931b2c-40d7-4467-addd-5cd8f54b31a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9931b2c-40d7-4467-addd-5cd8f54b31a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7f99a3c-0cc0-4842-94ec-f95cb25eecf9', 'volume_name': 'volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff517db6-2d7d-42c1-8a86-33e75fddf997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff517db6-2d7d-42c1-8a86-33e75fddf997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6768273f-7549-485e-81e3-310829369081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:47 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Volume a7f99a3c-0cc0-4842-94ec-f95cb25eecf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9', 'volume_size': 1} Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:47 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f24a801b-8ca4-4e05-b36a-c1b12c7c68d0 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.info" returned: 0 in 0.301s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:47 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-f24a801b-8ca4-4e05-b36a-c1b12c7c68d0 tempest-ProjectReaderTests-2023450681 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.info is being set with open permissions: ugo+rw Sep 10 18:38:47 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f24a801b-8ca4-4e05-b36a-c1b12c7c68d0 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:47 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.info Sep 10 18:38:47 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:48 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-f24a801b-8ca4-4e05-b36a-c1b12c7c68d0 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.info" returned: 0 in 0.306s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-f24a801b-8ca4-4e05-b36a-c1b12c7c68d0 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.518s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.427s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1612755096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f99a3c-0cc0-4842-94ec-f95cb25eecf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6ceb3234b46a4b8cb6b06de47d03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:48Z,use_quota=True,user_id='651651ec609e4eeda1eecd55281a7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Creating volume a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:38:48 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:48 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-f24a801b-8ca4-4e05-b36a-c1b12c7c68d0 tempest-ProjectReaderTests-2023450681 None] Create snapshot completed successfully Sep 10 18:38:48 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 1073741824 Sep 10 18:38:48 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Flow 'volume_create_manager' (cd7e2ef8-81d4-4319-bd6c-6a5f98d94a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3022c2-9cb4-4131-911b-8270c9a5288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3022c2-9cb4-4131-911b-8270c9a5288e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-116020494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee38f18-bf29-4682-8fb1-4f20cc38dc5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18bd0f5dc24475b5c64453528703e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:48Z,use_quota=True,user_id='3dbed0d7178d400abe88cfeae9d9e3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42675c7-140a-4ca6-9888-19defcb739eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42675c7-140a-4ca6-9888-19defcb739eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74010e26-6769-47b1-96b3-0c24c8567211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74010e26-6769-47b1-96b3-0c24c8567211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ee38f18-bf29-4682-8fb1-4f20cc38dc5f', 'volume_name': 'volume-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4361baac-ba64-4d8a-bca5-dd90adb36141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4361baac-ba64-4d8a-bca5-dd90adb36141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7fa6528-fd7b-44d0-bd33-bfa9eae081b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:48 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Volume 6ee38f18-bf29-4682-8fb1-4f20cc38dc5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f', 'volume_size': 1} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:48 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 1073741824" returned: 0 in 0.559s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:48 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 Sep 10 18:38:48 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-897b018d-4ba0-4a0e-a3ca-6e030ada041b-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] Lock "cinder-897b018d-4ba0-4a0e-a3ca-6e030ada041b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-quobyte-3c922aec-8667-4bb4-91cd-60254a41dc89" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-3c922aec-8667-4bb4-91cd-60254a41dc89" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-quobyte-897b018d-4ba0-4a0e-a3ca-6e030ada041b" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-897b018d-4ba0-4a0e-a3ca-6e030ada041b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] Deleting offline snapshot 897b018d-4ba0-4a0e-a3ca-6e030ada041b of volume 3c922aec-8667-4bb4-91cd-60254a41dc89 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:38:48 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] snapshot_file for this snap is: volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5885516f-6d22-4552-bd15-1f28a3d3e22e]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:49 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9" returned: 0 in 0.254s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:49 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b Sep 10 18:38:49 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.526s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-116020494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee38f18-bf29-4682-8fb1-4f20cc38dc5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18bd0f5dc24475b5c64453528703e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:48Z,use_quota=True,user_id='3dbed0d7178d400abe88cfeae9d9e3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Creating volume 6ee38f18-bf29-4682-8fb1-4f20cc38dc5f {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:38:49 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6768273f-7549-485e-81e3-310829369081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:49 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f 1073741824 Sep 10 18:38:49 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (044f5301-2317-40b6-9ee1-508cfa8b2861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:49 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Volume volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 (a7f99a3c-0cc0-4842-94ec-f95cb25eecf9): created successfully Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (044f5301-2317-40b6-9ee1-508cfa8b2861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Flow 'volume_create_manager' (5aa2182e-fde4-4bb8-8f7b-cc8d0da1b151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:49 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-9f86a984-78a9-4a6d-82ae-c8805263ee86 tempest-ProjectMemberTests-1340142452 None] Created volume successfully. Sep 10 18:38:49 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b" returned: 0 in 0.366s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c922aec-8667-4bb4-91cd-60254a41dc89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b10520-b60c-4e57-821d-f22b9eaa9332]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:49 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89 Sep 10 18:38:49 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:49 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f 1073741824" returned: 0 in 0.440s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:49 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f Sep 10 18:38:49 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:49 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89" returned: 0 in 0.403s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:49 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b Sep 10 18:38:49 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:49 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f" returned: 0 in 0.273s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7fa6528-fd7b-44d0-bd33-bfa9eae081b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9636a270-7700-46ef-baa1-a6a7b3d5d765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:49 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Volume volume-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f (6ee38f18-bf29-4682-8fb1-4f20cc38dc5f): created successfully Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9636a270-7700-46ef-baa1-a6a7b3d5d765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Flow 'volume_create_manager' (cd7e2ef8-81d4-4319-bd6c-6a5f98d94a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:49 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-a9df1ecf-5208-49bc-a994-a5c20f872f90 tempest-ProjectReaderTests-979417301 None] Created volume successfully. Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-547120b6-bc5d-4afb-afe8-0fd34a5e898f tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-547120b6-bc5d-4afb-afe8-0fd34a5e898f tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:49 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-547120b6-bc5d-4afb-afe8-0fd34a5e898f tempest-ProjectMemberTests-1340142452 None] Creating offline snapshot 6a5dd573-1fa9-4c7a-9115-ca244a347c32 of volume a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:38:50 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b571965-f8e7-4bee-9712-06db52ecce7c]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-547120b6-bc5d-4afb-afe8-0fd34a5e898f tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:50 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 Sep 10 18:38:50 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:50 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b" returned: 0 in 0.382s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:50 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b Sep 10 18:38:50 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:50 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-547120b6-bc5d-4afb-afe8-0fd34a5e898f tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9" returned: 0 in 0.353s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-547120b6-bc5d-4afb-afe8-0fd34a5e898f tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:50 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32 1G Sep 10 18:38:50 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:50 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89.897b018d-4ba0-4a0e-a3ca-6e030ada041b" returned: 0 in 0.271s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-897b018d-4ba0-4a0e-a3ca-6e030ada041b" released by "_delete_snapshot" :: held 1.531s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-3c922aec-8667-4bb4-91cd-60254a41dc89" released by "delete_snapshot" :: held 1.557s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:50 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] Created reservations ['8b39bd09-4354-47da-aef8-a88864ebd9f0', '19490045-489c-4776-8c5d-aebc02d2b2d4', '60d1719f-1c6e-41fa-b02a-04466658ec4e', '5856f5ae-e595-4f73-9907-23bb91d6771e'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:50 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] Delete snapshot completed successfully. Sep 10 18:38:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b2660378-d35a-47a6-8d75-7767b26b3e3b tempest-ProjectReaderTests-2023450681 None] Lock "cinder-897b018d-4ba0-4a0e-a3ca-6e030ada041b-delete_snapshot" released by "delete_snapshot" :: held 1.716s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:50 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] Acquiring lock "cinder-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-547120b6-bc5d-4afb-afe8-0fd34a5e898f tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32 1G" returned: 0 in 0.438s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-547120b6-bc5d-4afb-afe8-0fd34a5e898f tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:50 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32 Sep 10 18:38:50 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] Lock "cinder-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] Acquiring lock "cinder-quobyte-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:50 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] Lock "cinder-quobyte-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f" acquired by "delete_volume" :: waited 0.020s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:50 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c69d24d-ce61-4f73-8dd1-2be286a3ede6]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:50 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:51 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f Sep 10 18:38:51 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-3c922aec-8667-4bb4-91cd-60254a41dc89-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:51 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-547120b6-bc5d-4afb-afe8-0fd34a5e898f tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32" returned: 0 in 0.315s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:51 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-547120b6-bc5d-4afb-afe8-0fd34a5e898f tempest-ProjectMemberTests-1340142452 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32 is being set with open permissions: ugo+rw Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-547120b6-bc5d-4afb-afe8-0fd34a5e898f tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-3c922aec-8667-4bb4-91cd-60254a41dc89-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:51 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32 Sep 10 18:38:51 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-quobyte-3c922aec-8667-4bb4-91cd-60254a41dc89" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-3c922aec-8667-4bb4-91cd-60254a41dc89" acquired by "delete_volume" :: waited 0.020s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eed57f4-85d2-4bda-a409-ade16bd2c71d]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:51 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f" returned: 0 in 0.408s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:51 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f Sep 10 18:38:51 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:51 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89 Sep 10 18:38:51 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:51 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-547120b6-bc5d-4afb-afe8-0fd34a5e898f tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32" returned: 0 in 0.289s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-547120b6-bc5d-4afb-afe8-0fd34a5e898f tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:51 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.info Sep 10 18:38:51 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:51 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f" returned: 0 in 0.282s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] Lock "cinder-quobyte-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f" released by "delete_volume" :: held 0.734s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:51 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89" returned: 0 in 0.388s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:51 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89 Sep 10 18:38:51 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] Created reservations ['5c6ab757-ca0d-4568-b228-beac4bbffba8', 'e950fde2-267c-4e1c-a9f3-2201ab0b7dca', '56d881c9-f3d4-45eb-bc56-eb6e1e2857c2', '4dc041a0-f1cc-4dc5-a94c-f0cc1d9c5641'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:51 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-547120b6-bc5d-4afb-afe8-0fd34a5e898f tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.info" returned: 0 in 0.268s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:51 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-547120b6-bc5d-4afb-afe8-0fd34a5e898f tempest-ProjectMemberTests-1340142452 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.info is being set with open permissions: ugo+rw Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-547120b6-bc5d-4afb-afe8-0fd34a5e898f tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:51 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.info Sep 10 18:38:51 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:51 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:51 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:51 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-3c922aec-8667-4bb4-91cd-60254a41dc89" returned: 0 in 0.278s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-3c922aec-8667-4bb4-91cd-60254a41dc89" released by "delete_volume" :: held 0.736s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:51 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] Created reservations ['f2471bb1-9615-4284-bd59-3d2a2901e3de', '388ed504-575a-43b1-8d82-688c2e8d9275', 'f270e771-2d9c-409c-aee2-ec52c1e2b08f', '2b421e7c-e368-4661-9d45-dd7e4252f937'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:52 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-547120b6-bc5d-4afb-afe8-0fd34a5e898f tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.info" returned: 0 in 0.306s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-547120b6-bc5d-4afb-afe8-0fd34a5e898f tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:52 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.284s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:52 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] Deleted volume successfully. Sep 10 18:38:52 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-547120b6-bc5d-4afb-afe8-0fd34a5e898f tempest-ProjectMemberTests-1340142452 None] Create snapshot completed successfully Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4063588b-17a5-4909-b389-6e92e2b55324 tempest-ProjectReaderTests-979417301 None] Lock "cinder-6ee38f18-bf29-4682-8fb1-4f20cc38dc5f-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:52 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:52 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:52 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.272s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:52 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] Deleted volume successfully. Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-e48a5230-254c-4216-99c4-afbe413c5b74 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-3c922aec-8667-4bb4-91cd-60254a41dc89-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Flow 'volume_create_manager' (d0d9a8b0-9cad-4bed-a9a0-028216a333d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d20adf5-1e57-4370-9c4d-1afa382cb297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d20adf5-1e57-4370-9c4d-1afa382cb297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1804659921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5959f44-39c6-4ebc-ab2b-4308fb81ddf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a70d887ae1054c498c5ecfe7d64af23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:53Z,use_quota=True,user_id='20c569b28e764336b08fa2022c80a295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5dbb59-f8dc-4faa-926c-0aad6de74533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5dbb59-f8dc-4faa-926c-0aad6de74533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035bdc26-64e6-4427-aefc-897b7cdd5b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035bdc26-64e6-4427-aefc-897b7cdd5b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5959f44-39c6-4ebc-ab2b-4308fb81ddf1', 'volume_name': 'volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2fee15a-9bd5-4cc0-ba23-f44ae7a5158a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2fee15a-9bd5-4cc0-ba23-f44ae7a5158a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93f1719-a2a4-4a7f-8cc2-99e713d128f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:52 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Volume d5959f44-39c6-4ebc-ab2b-4308fb81ddf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1', 'volume_size': 1} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1804659921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5959f44-39c6-4ebc-ab2b-4308fb81ddf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a70d887ae1054c498c5ecfe7d64af23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:53Z,use_quota=True,user_id='20c569b28e764336b08fa2022c80a295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Creating volume d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:38:52 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:52 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:38:52 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 1073741824 Sep 10 18:38:52 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Flow 'volume_create_manager' (b1af96a5-7489-4071-b11f-e4f025a1626f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9211a4dc-b291-4d41-a6f2-e591d6511a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9211a4dc-b291-4d41-a6f2-e591d6511a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-23468711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa4defe-9e06-41b4-8117-b0ed1e36b9ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18bd0f5dc24475b5c64453528703e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:53Z,use_quota=True,user_id='3dbed0d7178d400abe88cfeae9d9e3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81b1ed1-fe14-4c88-8e70-ab73f3238159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81b1ed1-fe14-4c88-8e70-ab73f3238159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08b57b2-f46b-4de2-8400-bc21e2f1478a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08b57b2-f46b-4de2-8400-bc21e2f1478a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aa4defe-9e06-41b4-8117-b0ed1e36b9ff', 'volume_name': 'volume-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7782a3b-3763-433a-baf2-5f4b09df1ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7782a3b-3763-433a-baf2-5f4b09df1ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11cd647f-b605-4799-917b-5e373190bdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:53 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Volume 9aa4defe-9e06-41b4-8117-b0ed1e36b9ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff', 'volume_size': 1} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-6a5dd573-1fa9-4c7a-9115-ca244a347c32-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] Lock "cinder-6a5dd573-1fa9-4c7a-9115-ca244a347c32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-6a5dd573-1fa9-4c7a-9115-ca244a347c32" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-6a5dd573-1fa9-4c7a-9115-ca244a347c32" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] Deleting offline snapshot 6a5dd573-1fa9-4c7a-9115-ca244a347c32 of volume a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] snapshot_file for this snap is: volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61e3438-a5bf-4023-a58e-1a431e9b1ca5]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:53 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32 Sep 10 18:38:53 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:53 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 1073741824" returned: 0 in 0.450s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:53 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 Sep 10 18:38:53 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:53 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32" returned: 0 in 0.375s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a617f37d-6ec9-4c22-abd2-5966d86eaeb2]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:53 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 Sep 10 18:38:53 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:53 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1" returned: 0 in 0.267s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.652s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-23468711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa4defe-9e06-41b4-8117-b0ed1e36b9ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18bd0f5dc24475b5c64453528703e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:53Z,use_quota=True,user_id='3dbed0d7178d400abe88cfeae9d9e3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Creating volume 9aa4defe-9e06-41b4-8117-b0ed1e36b9ff {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:38:53 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:53 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff 1073741824 Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93f1719-a2a4-4a7f-8cc2-99e713d128f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:53 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b93438b-3871-437d-9d78-d4589ee682ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:53 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Volume volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 (d5959f44-39c6-4ebc-ab2b-4308fb81ddf1): created successfully Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b93438b-3871-437d-9d78-d4589ee682ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Flow 'volume_create_manager' (d0d9a8b0-9cad-4bed-a9a0-028216a333d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:53 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4d60ddc2-5407-481c-9e8e-fa2a351d4d65 tempest-ProjectReaderTests-2023450681 None] Created volume successfully. Sep 10 18:38:53 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9" returned: 0 in 0.370s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:53 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32 Sep 10 18:38:53 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:54 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff 1073741824" returned: 0 in 0.431s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:54 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff Sep 10 18:38:54 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:54 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32" returned: 0 in 0.334s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:54 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32 Sep 10 18:38:54 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:54 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff" returned: 0 in 0.257s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11cd647f-b605-4799-917b-5e373190bdff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b574a9-49b8-43f9-a834-441bd50f58a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:54 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Volume volume-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff (9aa4defe-9e06-41b4-8117-b0ed1e36b9ff): created successfully Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b574a9-49b8-43f9-a834-441bd50f58a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Flow 'volume_create_manager' (b1af96a5-7489-4071-b11f-e4f025a1626f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:54 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-6a78b5da-31c3-4960-960e-b388962b0871 tempest-ProjectReaderTests-979417301 None] Created volume successfully. Sep 10 18:38:54 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9.6a5dd573-1fa9-4c7a-9115-ca244a347c32" returned: 0 in 0.244s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-6a5dd573-1fa9-4c7a-9115-ca244a347c32" released by "_delete_snapshot" :: held 1.403s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9" released by "delete_snapshot" :: held 1.424s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] Created reservations ['c8d1788c-f09c-4c9e-aa4d-597269e8ff98', '203b372c-61f3-4f0d-9771-2e58fa0781fc', '62b3d59b-7c57-4a46-93b3-0ffc9abe24bf', '65787e34-c0af-4b70-b78a-f0e081394350'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:54 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] Delete snapshot completed successfully. Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-c273a72c-a2cc-4805-895f-323f396432ca tempest-ProjectMemberTests-1340142452 None] Lock "cinder-6a5dd573-1fa9-4c7a-9115-ca244a347c32-delete_snapshot" released by "delete_snapshot" :: held 1.547s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] Acquiring lock "cinder-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] Lock "cinder-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] Acquiring lock "cinder-quobyte-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7c42ef5a-a8b8-4c14-a021-9e6dacbcad67 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7c42ef5a-a8b8-4c14-a021-9e6dacbcad67 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-7c42ef5a-a8b8-4c14-a021-9e6dacbcad67 tempest-ProjectReaderTests-2023450681 None] Creating offline snapshot acab269d-38b2-47ba-9aff-0ed74eecc5f0 of volume d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] Lock "cinder-quobyte-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff" acquired by "delete_volume" :: waited 0.028s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee83ae5-f996-4f0e-a697-4b025521250f]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c42ef5a-a8b8-4c14-a021-9e6dacbcad67 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dca97b-638d-45c9-bcce-56714b4fce85]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:55 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 Sep 10 18:38:55 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:55 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff Sep 10 18:38:55 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] Lock "cinder-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9" acquired by "delete_volume" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:55 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c42ef5a-a8b8-4c14-a021-9e6dacbcad67 tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1" returned: 0 in 0.419s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c42ef5a-a8b8-4c14-a021-9e6dacbcad67 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:55 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b83904-b891-40e5-ab6f-dbfc1261cf15]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:55 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0 1G Sep 10 18:38:55 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff" returned: 0 in 0.441s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:55 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff Sep 10 18:38:55 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:55 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 Sep 10 18:38:55 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:55 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff" returned: 0 in 0.264s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] Lock "cinder-quobyte-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff" released by "delete_volume" :: held 0.749s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] Created reservations ['f34335b9-c78f-406f-a4d4-cc2b28156663', '45eefe95-b496-499a-9b65-e8a11203b784', 'f0516baf-33fa-484e-93c6-6c5d76a80598', '58601de7-27f0-4b1d-abfa-2881881c7f79'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:55 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9" returned: 0 in 0.392s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:55 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c42ef5a-a8b8-4c14-a021-9e6dacbcad67 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0 1G" returned: 0 in 0.435s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c42ef5a-a8b8-4c14-a021-9e6dacbcad67 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:55 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9 Sep 10 18:38:55 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:55 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0 Sep 10 18:38:55 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:55 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:55 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:56 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9" returned: 0 in 0.278s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9" released by "delete_volume" :: held 0.762s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:56 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:56 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.291s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c42ef5a-a8b8-4c14-a021-9e6dacbcad67 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0" returned: 0 in 0.345s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:56 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-7c42ef5a-a8b8-4c14-a021-9e6dacbcad67 tempest-ProjectReaderTests-2023450681 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0 is being set with open permissions: ugo+rw Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c42ef5a-a8b8-4c14-a021-9e6dacbcad67 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:56 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] Deleted volume successfully. Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] Created reservations ['c084b3a8-05a3-4893-8f5f-e4331a441fc3', 'c8144d0b-5ad5-4d5b-8904-ac3ae18e1425', 'ad704b7d-3bfd-466f-806e-4029c04e3277', 'b4ed7849-a61a-492a-b32f-b59d3d180cd4'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:56 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0 Sep 10 18:38:56 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9741b5e4-4f7f-4dd1-b010-94074983fa6a tempest-ProjectReaderTests-979417301 None] Lock "cinder-9aa4defe-9e06-41b4-8117-b0ed1e36b9ff-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:56 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:56 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:56 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c42ef5a-a8b8-4c14-a021-9e6dacbcad67 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0" returned: 0 in 0.285s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c42ef5a-a8b8-4c14-a021-9e6dacbcad67 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:56 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.info Sep 10 18:38:56 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Flow 'volume_create_manager' (395cafd3-ebb9-44de-870c-64dd23d344b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46fdc8b2-be4b-44d1-9d6c-8ae9ab75bb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:56 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.383s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:38:56 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] Deleted volume successfully. Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46fdc8b2-be4b-44d1-9d6c-8ae9ab75bb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1972789677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10c214c-75d9-458f-8bd1-c150d18664e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18bd0f5dc24475b5c64453528703e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:57Z,use_quota=True,user_id='3dbed0d7178d400abe88cfeae9d9e3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853e6345-d6b2-4af0-915e-a1a2d1e0e978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853e6345-d6b2-4af0-915e-a1a2d1e0e978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b09b7c-738a-4c5a-9dbb-85ed69496f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b09b7c-738a-4c5a-9dbb-85ed69496f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e10c214c-75d9-458f-8bd1-c150d18664e2', 'volume_name': 'volume-e10c214c-75d9-458f-8bd1-c150d18664e2', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ca5ea7-68ae-451e-aa5a-fb51e0e6d742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ca5ea7-68ae-451e-aa5a-fb51e0e6d742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d1a63a-d323-4c12-bd23-8051676d32b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:56 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Volume e10c214c-75d9-458f-8bd1-c150d18664e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e10c214c-75d9-458f-8bd1-c150d18664e2', 'volume_size': 1} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-d14c4c49-17c1-4847-9c13-5852ccce345a tempest-ProjectMemberTests-1340142452 None] Lock "cinder-a7f99a3c-0cc0-4842-94ec-f95cb25eecf9-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:56 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c42ef5a-a8b8-4c14-a021-9e6dacbcad67 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.info" returned: 0 in 0.337s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:56 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-7c42ef5a-a8b8-4c14-a021-9e6dacbcad67 tempest-ProjectReaderTests-2023450681 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.info is being set with open permissions: ugo+rw Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c42ef5a-a8b8-4c14-a021-9e6dacbcad67 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:56 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.info Sep 10 18:38:56 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Flow 'volume_create_manager' (1c0481b2-699b-4124-8796-9791b461a423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:56 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aadc0bf2-f2a0-485c-b1ec-c828574892bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aadc0bf2-f2a0-485c-b1ec-c828574892bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-581792303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf08994-5f4a-4ea6-9818-a44e8d1744d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6ceb3234b46a4b8cb6b06de47d03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:57Z,use_quota=True,user_id='651651ec609e4eeda1eecd55281a7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4dee85-01eb-4b9e-a188-3d76b68e1b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4dee85-01eb-4b9e-a188-3d76b68e1b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47755056-6439-4536-b385-99b58283b337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47755056-6439-4536-b385-99b58283b337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf08994-5f4a-4ea6-9818-a44e8d1744d0', 'volume_name': 'volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a102180-51d7-44e0-9b58-75f294d144cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a102180-51d7-44e0-9b58-75f294d144cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f57c4e-fd1f-429d-9bd8-fc07e6484841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:57 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Volume ebf08994-5f4a-4ea6-9818-a44e8d1744d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0', 'volume_size': 1} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:57 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-7c42ef5a-a8b8-4c14-a021-9e6dacbcad67 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.info" returned: 0 in 0.248s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-7c42ef5a-a8b8-4c14-a021-9e6dacbcad67 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.161s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.371s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1972789677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10c214c-75d9-458f-8bd1-c150d18664e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18bd0f5dc24475b5c64453528703e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:57Z,use_quota=True,user_id='3dbed0d7178d400abe88cfeae9d9e3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Creating volume e10c214c-75d9-458f-8bd1-c150d18664e2 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:38:57 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e10c214c-75d9-458f-8bd1-c150d18664e2 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:57 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e10c214c-75d9-458f-8bd1-c150d18664e2 1073741824 Sep 10 18:38:57 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:57 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-7c42ef5a-a8b8-4c14-a021-9e6dacbcad67 tempest-ProjectReaderTests-2023450681 None] Create snapshot completed successfully Sep 10 18:38:57 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e10c214c-75d9-458f-8bd1-c150d18664e2 1073741824" returned: 0 in 0.429s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e10c214c-75d9-458f-8bd1-c150d18664e2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:57 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e10c214c-75d9-458f-8bd1-c150d18664e2 Sep 10 18:38:57 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:57 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e10c214c-75d9-458f-8bd1-c150d18664e2" returned: 0 in 0.238s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.781s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-581792303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf08994-5f4a-4ea6-9818-a44e8d1744d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6ceb3234b46a4b8cb6b06de47d03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:38:57Z,use_quota=True,user_id='651651ec609e4eeda1eecd55281a7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Creating volume ebf08994-5f4a-4ea6-9818-a44e8d1744d0 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:38:57 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d1a63a-d323-4c12-bd23-8051676d32b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e10c214c-75d9-458f-8bd1-c150d18664e2', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:57 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0 1073741824 Sep 10 18:38:57 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9464537b-a962-4782-bce8-118c4c9d296e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:57 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Volume volume-e10c214c-75d9-458f-8bd1-c150d18664e2 (e10c214c-75d9-458f-8bd1-c150d18664e2): created successfully Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9464537b-a962-4782-bce8-118c4c9d296e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:57 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Flow 'volume_create_manager' (395cafd3-ebb9-44de-870c-64dd23d344b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:57 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-23afbcd2-6056-4e98-a295-b9559d3ca0b2 tempest-ProjectReaderTests-979417301 None] Created volume successfully. Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-acab269d-38b2-47ba-9aff-0ed74eecc5f0-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-acab269d-38b2-47ba-9aff-0ed74eecc5f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-quobyte-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-quobyte-acab269d-38b2-47ba-9aff-0ed74eecc5f0" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-acab269d-38b2-47ba-9aff-0ed74eecc5f0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] Deleting offline snapshot acab269d-38b2-47ba-9aff-0ed74eecc5f0 of volume d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] snapshot_file for this snap is: volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[027ff522-af23-4c72-a5e1-a82eb116c5d2]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:58 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0 1073741824" returned: 0 in 0.454s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:58 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0 Sep 10 18:38:58 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:58 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0 Sep 10 18:38:58 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:58 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:58 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0" returned: 0 in 0.257s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0" returned: 0 in 0.380s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f57c4e-fd1f-429d-9bd8-fc07e6484841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58b28e1-6572-4357-bf1d-59dfc6a1757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d972e3-d015-4d61-97ad-44df41d4a8cd]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:58 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Volume volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0 (ebf08994-5f4a-4ea6-9818-a44e8d1744d0): created successfully Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58b28e1-6572-4357-bf1d-59dfc6a1757c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Flow 'volume_create_manager' (1c0481b2-699b-4124-8796-9791b461a423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:38:58 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-709101b7-44c9-4602-ada3-5bdca7ed5304 tempest-ProjectMemberTests-1340142452 None] Created volume successfully. Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] Acquiring lock "cinder-e10c214c-75d9-458f-8bd1-c150d18664e2-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:58 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] Lock "cinder-e10c214c-75d9-458f-8bd1-c150d18664e2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:58 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] Acquiring lock "cinder-quobyte-e10c214c-75d9-458f-8bd1-c150d18664e2" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] Lock "cinder-quobyte-e10c214c-75d9-458f-8bd1-c150d18664e2" acquired by "delete_volume" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e104d89-81f3-439f-811d-752a73372617]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:58 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e10c214c-75d9-458f-8bd1-c150d18664e2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:58 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e10c214c-75d9-458f-8bd1-c150d18664e2 Sep 10 18:38:58 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:59 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1" returned: 0 in 0.404s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:59 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0 Sep 10 18:38:59 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ecba4356-b31e-4703-92b1-d6bd2e2e790b tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ecba4356-b31e-4703-92b1-d6bd2e2e790b tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-ecba4356-b31e-4703-92b1-d6bd2e2e790b tempest-ProjectMemberTests-1340142452 None] Creating offline snapshot eeb9bdf9-a775-448a-b732-d18e5f99448e of volume ebf08994-5f4a-4ea6-9818-a44e8d1744d0 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:38:59 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a68914-e3d7-422d-bba9-a30c6d2a4280]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ecba4356-b31e-4703-92b1-d6bd2e2e790b tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e10c214c-75d9-458f-8bd1-c150d18664e2" returned: 0 in 0.429s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e10c214c-75d9-458f-8bd1-c150d18664e2 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:59 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e10c214c-75d9-458f-8bd1-c150d18664e2 Sep 10 18:38:59 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:59 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0 Sep 10 18:38:59 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:59 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0" returned: 0 in 0.381s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:59 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0 Sep 10 18:38:59 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:59 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-e10c214c-75d9-458f-8bd1-c150d18664e2" returned: 0 in 0.274s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] Lock "cinder-quobyte-e10c214c-75d9-458f-8bd1-c150d18664e2" released by "delete_volume" :: held 0.754s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] Created reservations ['dc63867e-5e3e-48b5-9f9a-05dd502f0cae', 'b8848edf-4718-412a-9b11-456201182696', 'cef5cfc3-fa85-494d-a436-deae2c4471d3', '20ba1b04-0264-4a18-b976-c1d3742982ff'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:59 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ecba4356-b31e-4703-92b1-d6bd2e2e790b tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0" returned: 0 in 0.385s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ecba4356-b31e-4703-92b1-d6bd2e2e790b tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:59 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e 1G Sep 10 18:38:59 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:59 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1.acab269d-38b2-47ba-9aff-0ed74eecc5f0" returned: 0 in 0.268s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-acab269d-38b2-47ba-9aff-0ed74eecc5f0" released by "_delete_snapshot" :: held 1.549s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1" released by "delete_snapshot" :: held 1.579s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:38:59 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:38:59 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] Created reservations ['25e74503-a1c3-4562-889c-ef5c0b11b569', '1b821df2-df38-4840-aa83-8a7eb044d335', '55f6bbe8-4953-4603-ab1b-7ab438efe767', '3d79c3d5-c43d-47e1-83b4-dacef5699e53'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:38:59 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] Delete snapshot completed successfully. Sep 10 18:38:59 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2a7e3b1a-509e-419f-a30b-69c06d97c481 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-acab269d-38b2-47ba-9aff-0ed74eecc5f0-delete_snapshot" released by "delete_snapshot" :: held 1.757s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:00 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.269s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:39:00 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] Deleted volume successfully. Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-9138e7f5-afe5-46f5-8ef7-ad361baa1f12 tempest-ProjectReaderTests-979417301 None] Lock "cinder-e10c214c-75d9-458f-8bd1-c150d18664e2-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:00 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ecba4356-b31e-4703-92b1-d6bd2e2e790b tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e 1G" returned: 0 in 0.446s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ecba4356-b31e-4703-92b1-d6bd2e2e790b tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:00 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e Sep 10 18:39:00 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-quobyte-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Flow 'volume_create_manager' (8625f764-bd92-4b4a-bbd8-ce09a183e0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a441101-2ba7-45a9-b2d7-6c4566f6a15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:00 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1" acquired by "delete_volume" :: waited 0.043s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ecba4356-b31e-4703-92b1-d6bd2e2e790b tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e" returned: 0 in 0.411s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a441101-2ba7-45a9-b2d7-6c4566f6a15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-35323210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea24ab1-1975-4876-bed9-35c7bc9e1559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18bd0f5dc24475b5c64453528703e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:39:00Z,use_quota=True,user_id='3dbed0d7178d400abe88cfeae9d9e3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6dbdb60-17f7-4933-a2f6-8e3663b38e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6dbdb60-17f7-4933-a2f6-8e3663b38e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52027fd6-f6bb-4a4a-847c-2fd67c66275d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52027fd6-f6bb-4a4a-847c-2fd67c66275d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ea24ab1-1975-4876-bed9-35c7bc9e1559', 'volume_name': 'volume-0ea24ab1-1975-4876-bed9-35c7bc9e1559', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6aa377d-e97d-40d3-b35c-487320612d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6aa377d-e97d-40d3-b35c-487320612d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b06fd8-9078-4b07-a3f3-a49649a4c6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:00 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Volume 0ea24ab1-1975-4876-bed9-35c7bc9e1559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ea24ab1-1975-4876-bed9-35c7bc9e1559', 'volume_size': 1} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:00 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-ecba4356-b31e-4703-92b1-d6bd2e2e790b tempest-ProjectMemberTests-1340142452 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e is being set with open permissions: ugo+rw Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ecba4356-b31e-4703-92b1-d6bd2e2e790b tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eea0507-3f50-46e0-99ae-cfb98621c9fe]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:00 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e Sep 10 18:39:00 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:00 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 Sep 10 18:39:00 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:00 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ecba4356-b31e-4703-92b1-d6bd2e2e790b tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e" returned: 0 in 0.251s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ecba4356-b31e-4703-92b1-d6bd2e2e790b tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:00 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.info Sep 10 18:39:00 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:00 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1" returned: 0 in 0.358s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:00 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1 Sep 10 18:39:00 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:01 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ecba4356-b31e-4703-92b1-d6bd2e2e790b tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.info" returned: 0 in 0.265s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:01 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-ecba4356-b31e-4703-92b1-d6bd2e2e790b tempest-ProjectMemberTests-1340142452 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.info is being set with open permissions: ugo+rw Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ecba4356-b31e-4703-92b1-d6bd2e2e790b tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:01 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.info Sep 10 18:39:01 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:01 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1" returned: 0 in 0.258s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1" released by "delete_volume" :: held 0.717s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] Created reservations ['bcc1ca23-7dde-42dd-948f-67d4a0d47d6e', 'ede6ff3c-f41a-4068-9fc5-93e3a93cbd0e', 'f2a6dbe7-6402-4fa2-896b-364e87a96d02', '3bcd5d78-c5a7-4203-85b0-799818612ace'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:01 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:39:01 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:01 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-ecba4356-b31e-4703-92b1-d6bd2e2e790b tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.info" returned: 0 in 0.273s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-ecba4356-b31e-4703-92b1-d6bd2e2e790b tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-35323210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea24ab1-1975-4876-bed9-35c7bc9e1559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18bd0f5dc24475b5c64453528703e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:39:00Z,use_quota=True,user_id='3dbed0d7178d400abe88cfeae9d9e3d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Creating volume 0ea24ab1-1975-4876-bed9-35c7bc9e1559 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:39:01 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ea24ab1-1975-4876-bed9-35c7bc9e1559 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:01 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ea24ab1-1975-4876-bed9-35c7bc9e1559 1073741824 Sep 10 18:39:01 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:01 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-ecba4356-b31e-4703-92b1-d6bd2e2e790b tempest-ProjectMemberTests-1340142452 None] Create snapshot completed successfully Sep 10 18:39:01 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.297s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:39:01 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] Deleted volume successfully. Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4236e3d6-7f54-4aec-bce2-a4a847854038 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-d5959f44-39c6-4ebc-ab2b-4308fb81ddf1-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:01 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ea24ab1-1975-4876-bed9-35c7bc9e1559 1073741824" returned: 0 in 0.490s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ea24ab1-1975-4876-bed9-35c7bc9e1559 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:01 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ea24ab1-1975-4876-bed9-35c7bc9e1559 Sep 10 18:39:01 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Flow 'volume_create_manager' (87ba2774-df39-4546-a0c9-e9485e5bc40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5314a4-997a-4be7-a663-559af62d0ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5314a4-997a-4be7-a663-559af62d0ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1311622347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8b46d46-c764-4599-b3d5-c280aec072db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a70d887ae1054c498c5ecfe7d64af23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:39:02Z,use_quota=True,user_id='20c569b28e764336b08fa2022c80a295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7453ef93-5465-4398-8412-75e6f1c0d581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7453ef93-5465-4398-8412-75e6f1c0d581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28040ba-85be-4d1e-89d4-8d20d2fcbd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28040ba-85be-4d1e-89d4-8d20d2fcbd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8b46d46-c764-4599-b3d5-c280aec072db', 'volume_name': 'volume-f8b46d46-c764-4599-b3d5-c280aec072db', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624196aa-3c9e-4b8c-b2ef-cd7b7f1140a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624196aa-3c9e-4b8c-b2ef-cd7b7f1140a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7fb437-15ae-47a5-bd73-30161ab37546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:02 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Volume f8b46d46-c764-4599-b3d5-c280aec072db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8b46d46-c764-4599-b3d5-c280aec072db', 'volume_size': 1} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:02 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ea24ab1-1975-4876-bed9-35c7bc9e1559" returned: 0 in 0.260s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.098s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1311622347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8b46d46-c764-4599-b3d5-c280aec072db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a70d887ae1054c498c5ecfe7d64af23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:39:02Z,use_quota=True,user_id='20c569b28e764336b08fa2022c80a295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Creating volume f8b46d46-c764-4599-b3d5-c280aec072db {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:39:02 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b06fd8-9078-4b07-a3f3-a49649a4c6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ea24ab1-1975-4876-bed9-35c7bc9e1559', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:02 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db 1073741824 Sep 10 18:39:02 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952a8886-8743-4d1d-bff6-f7a29f5840ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:02 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Volume volume-0ea24ab1-1975-4876-bed9-35c7bc9e1559 (0ea24ab1-1975-4876-bed9-35c7bc9e1559): created successfully Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952a8886-8743-4d1d-bff6-f7a29f5840ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Flow 'volume_create_manager' (8625f764-bd92-4b4a-bbd8-ce09a183e0e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:39:02 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-25291153-2fe5-4a94-8a75-b3d16318cd62 tempest-ProjectReaderTests-979417301 None] Created volume successfully. Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-eeb9bdf9-a775-448a-b732-d18e5f99448e-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-eeb9bdf9-a775-448a-b732-d18e5f99448e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-ebf08994-5f4a-4ea6-9818-a44e8d1744d0" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-ebf08994-5f4a-4ea6-9818-a44e8d1744d0" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-eeb9bdf9-a775-448a-b732-d18e5f99448e" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-eeb9bdf9-a775-448a-b732-d18e5f99448e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] Deleting offline snapshot eeb9bdf9-a775-448a-b732-d18e5f99448e of volume ebf08994-5f4a-4ea6-9818-a44e8d1744d0 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] snapshot_file for this snap is: volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dc3596-f660-46b5-9002-5c4972b0e6a3]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] Acquiring lock "cinder-0ea24ab1-1975-4876-bed9-35c7bc9e1559-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] Lock "cinder-0ea24ab1-1975-4876-bed9-35c7bc9e1559-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:02 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e Sep 10 18:39:02 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] Acquiring lock "cinder-quobyte-0ea24ab1-1975-4876-bed9-35c7bc9e1559" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] Lock "cinder-quobyte-0ea24ab1-1975-4876-bed9-35c7bc9e1559" acquired by "delete_volume" :: waited 0.018s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:02 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db 1073741824" returned: 0 in 0.502s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c86009c-98f9-4c5e-bc3d-1cfc4cb16825]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ea24ab1-1975-4876-bed9-35c7bc9e1559 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:02 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db Sep 10 18:39:02 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:02 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ea24ab1-1975-4876-bed9-35c7bc9e1559 Sep 10 18:39:02 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:02 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e" returned: 0 in 0.371s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27a77ee-55ad-4695-9e75-24e895848a0f]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:03 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db" returned: 0 in 0.276s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7fb437-15ae-47a5-bd73-30161ab37546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8b46d46-c764-4599-b3d5-c280aec072db', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf46321c-e121-4620-9102-59a18737eff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:03 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0 Sep 10 18:39:03 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:03 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Volume volume-f8b46d46-c764-4599-b3d5-c280aec072db (f8b46d46-c764-4599-b3d5-c280aec072db): created successfully Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf46321c-e121-4620-9102-59a18737eff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Flow 'volume_create_manager' (87ba2774-df39-4546-a0c9-e9485e5bc40e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:39:03 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-e2ffaa50-950f-4499-b466-b01977c40efc tempest-ProjectReaderTests-2023450681 None] Created volume successfully. Sep 10 18:39:03 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ea24ab1-1975-4876-bed9-35c7bc9e1559" returned: 0 in 0.396s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ea24ab1-1975-4876-bed9-35c7bc9e1559 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:03 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ea24ab1-1975-4876-bed9-35c7bc9e1559 Sep 10 18:39:03 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:03 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0" returned: 0 in 0.380s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:03 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e Sep 10 18:39:03 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:03 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-0ea24ab1-1975-4876-bed9-35c7bc9e1559" returned: 0 in 0.255s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] Lock "cinder-quobyte-0ea24ab1-1975-4876-bed9-35c7bc9e1559" released by "delete_volume" :: held 0.703s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] Created reservations ['d452dace-dc62-4f3a-9c06-9daedaa7f062', '1b11b331-0d9e-4bbf-bbf6-193a45012cf8', '11b36324-e260-4246-bcfc-22b6d59fe979', '68d7ee86-96bf-47e9-85e3-dc56b93d0744'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:03 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:39:03 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:03 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e" returned: 0 in 0.368s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:03 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e Sep 10 18:39:03 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:03 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.260s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:39:03 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] Deleted volume successfully. Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b1e3fbe6-6aad-49dc-9c69-c5c343e23468 tempest-ProjectReaderTests-979417301 None] Lock "cinder-0ea24ab1-1975-4876-bed9-35c7bc9e1559-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:03 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0.eeb9bdf9-a775-448a-b732-d18e5f99448e" returned: 0 in 0.247s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-eeb9bdf9-a775-448a-b732-d18e5f99448e" released by "_delete_snapshot" :: held 1.474s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-ebf08994-5f4a-4ea6-9818-a44e8d1744d0" released by "delete_snapshot" :: held 1.501s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:04 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] Created reservations ['56d9b295-d02f-40eb-953b-4ee1b7a341ba', 'ea49c4d2-ddd8-42d2-a206-078d4d789265', '2e729945-c919-41a7-a154-c20d3219b496', '93307409-b457-47d7-b9d2-baab41dc30f3'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:39:04 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] Delete snapshot completed successfully. Sep 10 18:39:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-2fe28b26-bc2f-43be-ad7a-617d5b66d901 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-eeb9bdf9-a775-448a-b732-d18e5f99448e-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6c4342b0-8758-4c6c-ab78-b021dcba4409 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6c4342b0-8758-4c6c-ab78-b021dcba4409 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:04 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-6c4342b0-8758-4c6c-ab78-b021dcba4409 tempest-ProjectReaderTests-2023450681 None] Creating offline snapshot c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa of volume f8b46d46-c764-4599-b3d5-c280aec072db {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:39:04 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2886e310-affa-4274-9a66-26e910c9f26c]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6c4342b0-8758-4c6c-ab78-b021dcba4409 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:04 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db Sep 10 18:39:04 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-ebf08994-5f4a-4ea6-9818-a44e8d1744d0-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-ebf08994-5f4a-4ea6-9818-a44e8d1744d0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-ebf08994-5f4a-4ea6-9818-a44e8d1744d0" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-ebf08994-5f4a-4ea6-9818-a44e8d1744d0" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:04 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6c4342b0-8758-4c6c-ab78-b021dcba4409 tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db" returned: 0 in 0.438s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6c4342b0-8758-4c6c-ab78-b021dcba4409 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:04 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c1fdc6-ba6d-4c31-87e7-786035d4ffa4]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:04 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa 1G Sep 10 18:39:04 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:04 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0 Sep 10 18:39:04 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:05 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0" returned: 0 in 0.391s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:05 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0 Sep 10 18:39:05 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:05 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6c4342b0-8758-4c6c-ab78-b021dcba4409 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa 1G" returned: 0 in 0.461s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6c4342b0-8758-4c6c-ab78-b021dcba4409 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8b46d46-c764-4599-b3d5-c280aec072db -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:05 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8b46d46-c764-4599-b3d5-c280aec072db -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa Sep 10 18:39:05 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:05 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-ebf08994-5f4a-4ea6-9818-a44e8d1744d0" returned: 0 in 0.295s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-ebf08994-5f4a-4ea6-9818-a44e8d1744d0" released by "delete_volume" :: held 0.767s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] Created reservations ['e37b9b86-9343-482a-ab60-b42e0119fcaf', 'd64f8aed-6e1d-49ee-bc2c-257fb17dcf5a', 'a5466a94-29e8-45b6-8806-cff53990fe4f', 'd3ef452c-b463-4d03-a3d5-6b0531ca0c22'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:39:05 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6c4342b0-8758-4c6c-ab78-b021dcba4409 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8b46d46-c764-4599-b3d5-c280aec072db -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa" returned: 0 in 0.367s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:05 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-6c4342b0-8758-4c6c-ab78-b021dcba4409 tempest-ProjectReaderTests-2023450681 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa is being set with open permissions: ugo+rw Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6c4342b0-8758-4c6c-ab78-b021dcba4409 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:05 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa Sep 10 18:39:05 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:05 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:39:05 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:05 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6c4342b0-8758-4c6c-ab78-b021dcba4409 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa" returned: 0 in 0.287s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:05 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.266s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6c4342b0-8758-4c6c-ab78-b021dcba4409 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:05 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] Deleted volume successfully. Sep 10 18:39:05 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.info Sep 10 18:39:05 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:05 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-0967696d-18cd-4517-a4c0-929a2cced801 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-ebf08994-5f4a-4ea6-9818-a44e8d1744d0-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:06 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6c4342b0-8758-4c6c-ab78-b021dcba4409 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.info" returned: 0 in 0.269s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:06 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-6c4342b0-8758-4c6c-ab78-b021dcba4409 tempest-ProjectReaderTests-2023450681 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.info is being set with open permissions: ugo+rw Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6c4342b0-8758-4c6c-ab78-b021dcba4409 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:06 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.info Sep 10 18:39:06 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Flow 'volume_create_manager' (cc54ee93-da47-431d-9e81-056cb4f1d85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d1e541-1226-4c5e-a675-8e61c00ae0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d1e541-1226-4c5e-a675-8e61c00ae0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1674312307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e6f709-6fa8-4898-8a6a-11ae62af59c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6ceb3234b46a4b8cb6b06de47d03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:39:06Z,use_quota=True,user_id='651651ec609e4eeda1eecd55281a7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b8b29e-5831-44f6-9f15-85ad59bb898f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b8b29e-5831-44f6-9f15-85ad59bb898f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f893fb4e-2e8d-4fe8-b581-8ab3045af527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f893fb4e-2e8d-4fe8-b581-8ab3045af527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76e6f709-6fa8-4898-8a6a-11ae62af59c9', 'volume_name': 'volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbaea352-1eab-4417-8546-e8c7aa9963d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbaea352-1eab-4417-8546-e8c7aa9963d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c188e6d5-7023-4d4a-8529-ba84b4de7470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:06 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Volume 76e6f709-6fa8-4898-8a6a-11ae62af59c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9', 'volume_size': 1} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:06 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-6c4342b0-8758-4c6c-ab78-b021dcba4409 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.info" returned: 0 in 0.261s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-6c4342b0-8758-4c6c-ab78-b021dcba4409 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.179s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.125s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1674312307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e6f709-6fa8-4898-8a6a-11ae62af59c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6ceb3234b46a4b8cb6b06de47d03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:39:06Z,use_quota=True,user_id='651651ec609e4eeda1eecd55281a7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Creating volume 76e6f709-6fa8-4898-8a6a-11ae62af59c9 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:39:06 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:06 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9 1073741824 Sep 10 18:39:06 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:06 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-6c4342b0-8758-4c6c-ab78-b021dcba4409 tempest-ProjectReaderTests-2023450681 None] Create snapshot completed successfully Sep 10 18:39:06 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9 1073741824" returned: 0 in 0.403s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:06 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:06 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9 Sep 10 18:39:06 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:07 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9" returned: 0 in 0.255s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c188e6d5-7023-4d4a-8529-ba84b4de7470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a9fbd0-bcfe-4433-8965-be17513cdb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:07 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Volume volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9 (76e6f709-6fa8-4898-8a6a-11ae62af59c9): created successfully Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a9fbd0-bcfe-4433-8965-be17513cdb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Flow 'volume_create_manager' (cc54ee93-da47-431d-9e81-056cb4f1d85f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:39:07 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-9cfae7e0-d73f-4d12-8cb0-925a37ac9b05 tempest-ProjectMemberTests-1340142452 None] Created volume successfully. Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-quobyte-f8b46d46-c764-4599-b3d5-c280aec072db" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-f8b46d46-c764-4599-b3d5-c280aec072db" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-quobyte-c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] Deleting offline snapshot c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa of volume f8b46d46-c764-4599-b3d5-c280aec072db {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] snapshot_file for this snap is: volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b6b92d-f160-4e98-9881-79309a010c10]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:07 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa Sep 10 18:39:07 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:07 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa" returned: 0 in 0.347s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8b46d46-c764-4599-b3d5-c280aec072db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc78a8d-3520-4081-8e19-29e729e563f5]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:07 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:08 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db Sep 10 18:39:08 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:08 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db" returned: 0 in 0.358s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:08 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa Sep 10 18:39:08 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8394eea4-0804-4ec6-bb91-3d3c8bae42f5 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8394eea4-0804-4ec6-bb91-3d3c8bae42f5 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:08 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-8394eea4-0804-4ec6-bb91-3d3c8bae42f5 tempest-ProjectMemberTests-1340142452 None] Creating offline snapshot c4b964a8-b4c5-48ed-bdc1-7f5ef2676800 of volume 76e6f709-6fa8-4898-8a6a-11ae62af59c9 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:39:08 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05771fe-575b-4823-9c6d-2abcc6f2cb41]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8394eea4-0804-4ec6-bb91-3d3c8bae42f5 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:08 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9 Sep 10 18:39:08 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:08 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa" returned: 0 in 0.348s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:08 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa Sep 10 18:39:08 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:08 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8394eea4-0804-4ec6-bb91-3d3c8bae42f5 tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9" returned: 0 in 0.359s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8394eea4-0804-4ec6-bb91-3d3c8bae42f5 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:08 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800 1G Sep 10 18:39:08 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:08 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:08 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db.c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa" returned: 0 in 0.248s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa" released by "_delete_snapshot" :: held 1.383s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:08 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-f8b46d46-c764-4599-b3d5-c280aec072db" released by "delete_snapshot" :: held 1.417s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:09 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] Created reservations ['c22f4605-6dea-4d8c-9426-e82c18a30a09', '2e101fde-0122-4545-bdf1-cdb2bd809666', '855af9d5-d8ed-4444-8bc3-a2a42940a136', 'e3805543-53ec-40e8-a7ba-838563f5a9ea'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:39:09 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] Delete snapshot completed successfully. Sep 10 18:39:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4a379858-4995-4710-9a99-41bb38d11378 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-c08e85d9-f9c1-496a-9d9b-5fb2dcf85dfa-delete_snapshot" released by "delete_snapshot" :: held 1.556s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:09 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8394eea4-0804-4ec6-bb91-3d3c8bae42f5 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800 1G" returned: 0 in 0.395s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8394eea4-0804-4ec6-bb91-3d3c8bae42f5 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:09 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800 Sep 10 18:39:09 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:09 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8394eea4-0804-4ec6-bb91-3d3c8bae42f5 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800" returned: 0 in 0.285s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:09 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-8394eea4-0804-4ec6-bb91-3d3c8bae42f5 tempest-ProjectMemberTests-1340142452 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800 is being set with open permissions: ugo+rw Sep 10 18:39:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8394eea4-0804-4ec6-bb91-3d3c8bae42f5 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:09 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800 Sep 10 18:39:09 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-f8b46d46-c764-4599-b3d5-c280aec072db-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] Lock "cinder-f8b46d46-c764-4599-b3d5-c280aec072db-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-quobyte-f8b46d46-c764-4599-b3d5-c280aec072db" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:09 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-f8b46d46-c764-4599-b3d5-c280aec072db" acquired by "delete_volume" :: waited 0.018s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:09 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a867620d-66ba-40e6-8702-80370cfe5747]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:09 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8394eea4-0804-4ec6-bb91-3d3c8bae42f5 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800" returned: 0 in 0.255s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:09 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8394eea4-0804-4ec6-bb91-3d3c8bae42f5 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:09 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.info Sep 10 18:39:09 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:09 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db Sep 10 18:39:09 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:10 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8394eea4-0804-4ec6-bb91-3d3c8bae42f5 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.info" returned: 0 in 0.255s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:10 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-8394eea4-0804-4ec6-bb91-3d3c8bae42f5 tempest-ProjectMemberTests-1340142452 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.info is being set with open permissions: ugo+rw Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8394eea4-0804-4ec6-bb91-3d3c8bae42f5 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:10 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.info Sep 10 18:39:10 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:10 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db" returned: 0 in 0.374s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:10 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db Sep 10 18:39:10 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:10 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8394eea4-0804-4ec6-bb91-3d3c8bae42f5 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.info" returned: 0 in 0.257s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8394eea4-0804-4ec6-bb91-3d3c8bae42f5 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:10 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-8394eea4-0804-4ec6-bb91-3d3c8bae42f5 tempest-ProjectMemberTests-1340142452 None] Create snapshot completed successfully Sep 10 18:39:10 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-f8b46d46-c764-4599-b3d5-c280aec072db" returned: 0 in 0.262s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-f8b46d46-c764-4599-b3d5-c280aec072db" released by "delete_volume" :: held 0.692s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] Created reservations ['4cbf54cc-6d0b-41d6-8ebb-2cd5ac8457ee', '9ea2bcb1-e52a-4644-8165-8803152b8328', '90eef351-2052-40c0-af05-968381eb918e', '892c77c3-7400-4a45-bab9-c3ee1ff1943a'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:10 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:39:10 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-c4b964a8-b4c5-48ed-bdc1-7f5ef2676800-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] Lock "cinder-c4b964a8-b4c5-48ed-bdc1-7f5ef2676800-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-76e6f709-6fa8-4898-8a6a-11ae62af59c9" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-76e6f709-6fa8-4898-8a6a-11ae62af59c9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-c4b964a8-b4c5-48ed-bdc1-7f5ef2676800" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-c4b964a8-b4c5-48ed-bdc1-7f5ef2676800" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] Deleting offline snapshot c4b964a8-b4c5-48ed-bdc1-7f5ef2676800 of volume 76e6f709-6fa8-4898-8a6a-11ae62af59c9 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] snapshot_file for this snap is: volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce9b2ea-143d-4910-a28e-a2bdae88a731]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:10 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.261s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:39:10 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] Deleted volume successfully. Sep 10 18:39:10 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-936d1625-0071-4ec5-8680-d931744015be tempest-ProjectReaderTests-2023450681 None] Lock "cinder-f8b46d46-c764-4599-b3d5-c280aec072db-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:10 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800 Sep 10 18:39:10 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:11 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800" returned: 0 in 0.392s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07e2ddc-9629-467d-baa8-226e32c691bd]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:11 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9 Sep 10 18:39:11 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Flow 'volume_create_manager' (1da75a4c-cdad-4817-a0f4-b11f372f9ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efae8918-5016-41ff-9d1b-b903a5afd2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efae8918-5016-41ff-9d1b-b903a5afd2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-466053772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270ff9f0-169a-4f02-b743-85f69c2d535d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a70d887ae1054c498c5ecfe7d64af23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:39:11Z,use_quota=True,user_id='20c569b28e764336b08fa2022c80a295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5166551b-3b1e-43dd-bd96-0020ec8f2623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5166551b-3b1e-43dd-bd96-0020ec8f2623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (636a2bbc-77ef-461a-9b10-d7c777a392f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (636a2bbc-77ef-461a-9b10-d7c777a392f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '270ff9f0-169a-4f02-b743-85f69c2d535d', 'volume_name': 'volume-270ff9f0-169a-4f02-b743-85f69c2d535d', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf150206-3764-463e-9a0a-9e10befaeb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf150206-3764-463e-9a0a-9e10befaeb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb4eddd-c56e-4077-8072-0205ada620a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:11 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Volume 270ff9f0-169a-4f02-b743-85f69c2d535d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-270ff9f0-169a-4f02-b743-85f69c2d535d', 'volume_size': 1} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-466053772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270ff9f0-169a-4f02-b743-85f69c2d535d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a70d887ae1054c498c5ecfe7d64af23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:39:11Z,use_quota=True,user_id='20c569b28e764336b08fa2022c80a295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Creating volume 270ff9f0-169a-4f02-b743-85f69c2d535d {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:39:11 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:11 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d 1073741824 Sep 10 18:39:11 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:11 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9" returned: 0 in 0.358s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:11 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800 Sep 10 18:39:11 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:11 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d 1073741824" returned: 0 in 0.436s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:11 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800" returned: 0 in 0.366s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:11 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:11 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d Sep 10 18:39:11 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:11 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800 Sep 10 18:39:11 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:12 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d" returned: 0 in 0.252s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:12 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9.c4b964a8-b4c5-48ed-bdc1-7f5ef2676800" returned: 0 in 0.248s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb4eddd-c56e-4077-8072-0205ada620a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-270ff9f0-169a-4f02-b743-85f69c2d535d', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56759ca-ac44-418c-b9e8-72b85b9e22e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-c4b964a8-b4c5-48ed-bdc1-7f5ef2676800" released by "_delete_snapshot" :: held 1.477s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-76e6f709-6fa8-4898-8a6a-11ae62af59c9" released by "delete_snapshot" :: held 1.498s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:12 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Volume volume-270ff9f0-169a-4f02-b743-85f69c2d535d (270ff9f0-169a-4f02-b743-85f69c2d535d): created successfully Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56759ca-ac44-418c-b9e8-72b85b9e22e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Flow 'volume_create_manager' (1da75a4c-cdad-4817-a0f4-b11f372f9ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:39:12 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-257072a3-4910-4e62-a2b4-5bbee19045b0 tempest-ProjectReaderTests-2023450681 None] Created volume successfully. Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] Created reservations ['40b1328d-3dcc-42e6-abcc-64f45c837978', 'c7d5b8dc-9fea-4d97-aac3-481051af3002', 'd5c9f9ca-dc5c-4117-9380-281de3bb2c09', '8bc32006-9d3d-49e8-a985-b8bbaed87f1f'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:39:12 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] Delete snapshot completed successfully. Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-b7444c65-83b4-4204-b87c-2f338ee0d5ae tempest-ProjectMemberTests-1340142452 None] Lock "cinder-c4b964a8-b4c5-48ed-bdc1-7f5ef2676800-delete_snapshot" released by "delete_snapshot" :: held 1.660s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d16a637c-6157-4a32-a58a-767526e4bac6 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d16a637c-6157-4a32-a58a-767526e4bac6 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-d16a637c-6157-4a32-a58a-767526e4bac6 tempest-ProjectReaderTests-2023450681 None] Creating offline snapshot ad1d8834-24c1-4a51-a814-a8c8181dc3a7 of volume 270ff9f0-169a-4f02-b743-85f69c2d535d {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[454d25aa-3ce4-43a5-8235-ee304fafbef0]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d16a637c-6157-4a32-a58a-767526e4bac6 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:12 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d Sep 10 18:39:12 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-76e6f709-6fa8-4898-8a6a-11ae62af59c9-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] Lock "cinder-76e6f709-6fa8-4898-8a6a-11ae62af59c9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-76e6f709-6fa8-4898-8a6a-11ae62af59c9" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-76e6f709-6fa8-4898-8a6a-11ae62af59c9" acquired by "delete_volume" :: waited 0.014s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:12 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d16a637c-6157-4a32-a58a-767526e4bac6 tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d" returned: 0 in 0.401s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d16a637c-6157-4a32-a58a-767526e4bac6 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8238bcef-04f3-4a09-bddc-1a66277a0adc]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:12 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:12 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7 1G Sep 10 18:39:12 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:13 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9 Sep 10 18:39:13 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:13 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9" returned: 0 in 0.370s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:13 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d16a637c-6157-4a32-a58a-767526e4bac6 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7 1G" returned: 0 in 0.409s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d16a637c-6157-4a32-a58a-767526e4bac6 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-270ff9f0-169a-4f02-b743-85f69c2d535d -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:13 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9 Sep 10 18:39:13 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:13 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-270ff9f0-169a-4f02-b743-85f69c2d535d -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7 Sep 10 18:39:13 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:13 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-76e6f709-6fa8-4898-8a6a-11ae62af59c9" returned: 0 in 0.254s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:13 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-76e6f709-6fa8-4898-8a6a-11ae62af59c9" released by "delete_volume" :: held 0.686s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:13 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] Created reservations ['0da3ab26-9f10-4328-9d17-b39303da10f9', 'b94a1c55-a7ed-43ad-9ca7-c12f7c4b93f4', 'b81c99a6-ba6b-474c-bde3-49ecbe9cd171', '4e17082f-cc85-4a6e-81f4-707f851666f1'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:39:13 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d16a637c-6157-4a32-a58a-767526e4bac6 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-270ff9f0-169a-4f02-b743-85f69c2d535d -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7" returned: 0 in 0.296s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:13 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-d16a637c-6157-4a32-a58a-767526e4bac6 tempest-ProjectReaderTests-2023450681 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7 is being set with open permissions: ugo+rw Sep 10 18:39:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d16a637c-6157-4a32-a58a-767526e4bac6 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:13 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7 Sep 10 18:39:13 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:39:13 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:39:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:13 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:39:13 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:13 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d16a637c-6157-4a32-a58a-767526e4bac6 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7" returned: 0 in 0.244s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d16a637c-6157-4a32-a58a-767526e4bac6 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:13 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.info Sep 10 18:39:13 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:13 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:13 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.270s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:13 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:39:13 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] Deleted volume successfully. Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-86dbc905-94c4-4b5d-b7e8-e318589b385e tempest-ProjectMemberTests-1340142452 None] Lock "cinder-76e6f709-6fa8-4898-8a6a-11ae62af59c9-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:14 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d16a637c-6157-4a32-a58a-767526e4bac6 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.info" returned: 0 in 0.272s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:14 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-d16a637c-6157-4a32-a58a-767526e4bac6 tempest-ProjectReaderTests-2023450681 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.info is being set with open permissions: ugo+rw Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d16a637c-6157-4a32-a58a-767526e4bac6 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:14 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.info Sep 10 18:39:14 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:14 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-d16a637c-6157-4a32-a58a-767526e4bac6 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.info" returned: 0 in 0.262s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-d16a637c-6157-4a32-a58a-767526e4bac6 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.968s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:14 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-d16a637c-6157-4a32-a58a-767526e4bac6 tempest-ProjectReaderTests-2023450681 None] Create snapshot completed successfully Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Flow 'volume_create_manager' (c5a44874-4c6a-4a8a-b469-01f9ce983fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa951202-386b-4eae-bc57-29576c827e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa951202-386b-4eae-bc57-29576c827e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1234978202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403bf9ac-4c93-41e0-a2ff-e8baa95cac4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6ceb3234b46a4b8cb6b06de47d03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:39:14Z,use_quota=True,user_id='651651ec609e4eeda1eecd55281a7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aead4d4-456d-429f-83b7-55748a4839e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aead4d4-456d-429f-83b7-55748a4839e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c54f12-c691-4fdd-9d46-81dbbfc4fe6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c54f12-c691-4fdd-9d46-81dbbfc4fe6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '403bf9ac-4c93-41e0-a2ff-e8baa95cac4d', 'volume_name': 'volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba56ab5-c1f5-4307-ab66-77ba24e0b793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba56ab5-c1f5-4307-ab66-77ba24e0b793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f97cc5-7972-4160-b734-0a0e6b57cb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:14 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Volume 403bf9ac-4c93-41e0-a2ff-e8baa95cac4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d', 'volume_size': 1} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1234978202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403bf9ac-4c93-41e0-a2ff-e8baa95cac4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6ceb3234b46a4b8cb6b06de47d03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:39:14Z,use_quota=True,user_id='651651ec609e4eeda1eecd55281a7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Creating volume 403bf9ac-4c93-41e0-a2ff-e8baa95cac4d {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:39:14 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-ad1d8834-24c1-4a51-a814-a8c8181dc3a7-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:14 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d 1073741824 Sep 10 18:39:14 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-ad1d8834-24c1-4a51-a814-a8c8181dc3a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-quobyte-270ff9f0-169a-4f02-b743-85f69c2d535d" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-270ff9f0-169a-4f02-b743-85f69c2d535d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-quobyte-ad1d8834-24c1-4a51-a814-a8c8181dc3a7" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-ad1d8834-24c1-4a51-a814-a8c8181dc3a7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] Deleting offline snapshot ad1d8834-24c1-4a51-a814-a8c8181dc3a7 of volume 270ff9f0-169a-4f02-b743-85f69c2d535d {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] snapshot_file for this snap is: volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f457cc-8174-495a-b3f7-9952344029e2]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:14 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7 Sep 10 18:39:14 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:14 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:14 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d 1073741824" returned: 0 in 0.413s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:15 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d Sep 10 18:39:15 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:15 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7" returned: 0 in 0.406s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-270ff9f0-169a-4f02-b743-85f69c2d535d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:39:15 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[223ed47d-2cbf-4c54-b9c5-9d2184398fd9]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:15 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d Sep 10 18:39:15 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:15 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d" returned: 0 in 0.268s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:15 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:39:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f97cc5-7972-4160-b734-0a0e6b57cb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b22f90-f6d5-45fb-aa1a-a5e0b8a7c2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:15 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Volume volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d (403bf9ac-4c93-41e0-a2ff-e8baa95cac4d): created successfully Sep 10 18:39:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b22f90-f6d5-45fb-aa1a-a5e0b8a7c2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:15 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Flow 'volume_create_manager' (c5a44874-4c6a-4a8a-b469-01f9ce983fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:39:15 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-0fe2a853-98dc-4a4b-b54e-ebfd8cd06c7e tempest-ProjectMemberTests-1340142452 None] Created volume successfully. Sep 10 18:39:15 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d" returned: 0 in 0.385s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:15 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7 Sep 10 18:39:15 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:15 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7" returned: 0 in 0.322s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:15 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:15 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7 Sep 10 18:39:15 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:16 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d.ad1d8834-24c1-4a51-a814-a8c8181dc3a7" returned: 0 in 0.248s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-ad1d8834-24c1-4a51-a814-a8c8181dc3a7" released by "_delete_snapshot" :: held 1.453s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-270ff9f0-169a-4f02-b743-85f69c2d535d" released by "delete_snapshot" :: held 1.476s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:16 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] Created reservations ['35911d54-919c-44b6-8d16-c21ced2521f3', '925fda3a-ecd4-4535-bb14-242f85cd6fa5', '508d4adf-5a23-4d7f-abdb-5844a4f38c14', '61693cbd-6489-428d-8672-9a8b0dca00dc'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:39:16 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] Delete snapshot completed successfully. Sep 10 18:39:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8e723d12-7774-49c3-81b7-14bd97178958 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-ad1d8834-24c1-4a51-a814-a8c8181dc3a7-delete_snapshot" released by "delete_snapshot" :: held 1.601s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-24cfff19-9221-453b-a0e5-5d1f79b2953e tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-24cfff19-9221-453b-a0e5-5d1f79b2953e tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:16 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-24cfff19-9221-453b-a0e5-5d1f79b2953e tempest-ProjectMemberTests-1340142452 None] Creating offline snapshot 605fbcc3-e8b7-4035-99fd-5ab4f209c1bf of volume 403bf9ac-4c93-41e0-a2ff-e8baa95cac4d {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:39:16 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[389122f4-569f-4638-b25c-6d9166e49143]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-24cfff19-9221-453b-a0e5-5d1f79b2953e tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-270ff9f0-169a-4f02-b743-85f69c2d535d-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:16 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d Sep 10 18:39:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-270ff9f0-169a-4f02-b743-85f69c2d535d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:16 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "cinder-quobyte-270ff9f0-169a-4f02-b743-85f69c2d535d" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:16 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-270ff9f0-169a-4f02-b743-85f69c2d535d" acquired by "delete_volume" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:16 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c98bbd-9586-4d4a-a989-893e3059dc7b]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:16 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:17 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d Sep 10 18:39:17 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:17 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-24cfff19-9221-453b-a0e5-5d1f79b2953e tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d" returned: 0 in 0.381s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-24cfff19-9221-453b-a0e5-5d1f79b2953e tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:17 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf 1G Sep 10 18:39:17 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:17 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d" returned: 0 in 0.383s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:17 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d Sep 10 18:39:17 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:17 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-24cfff19-9221-453b-a0e5-5d1f79b2953e tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf 1G" returned: 0 in 0.453s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-24cfff19-9221-453b-a0e5-5d1f79b2953e tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:17 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf Sep 10 18:39:17 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:17 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-270ff9f0-169a-4f02-b743-85f69c2d535d" returned: 0 in 0.275s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:17 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-quobyte-270ff9f0-169a-4f02-b743-85f69c2d535d" released by "delete_volume" :: held 0.720s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:17 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] Created reservations ['1ade7a32-25f4-4606-a407-24b7d2934c94', '3c1aa36e-c931-4159-bcfc-c7a3e5e4b082', '2051014f-5e79-48c6-a0c4-b8afb02b37d3', '20bac1a9-58e4-4ac2-b0e4-1eb1fe12266d'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:39:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:39:17 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:39:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:17 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:39:17 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:17 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-24cfff19-9221-453b-a0e5-5d1f79b2953e tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf" returned: 0 in 0.345s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:17 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-24cfff19-9221-453b-a0e5-5d1f79b2953e tempest-ProjectMemberTests-1340142452 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf is being set with open permissions: ugo+rw Sep 10 18:39:17 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-24cfff19-9221-453b-a0e5-5d1f79b2953e tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:17 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf Sep 10 18:39:17 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:17 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.283s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:18 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:39:18 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] Deleted volume successfully. Sep 10 18:39:18 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-bcadf2d2-99fe-415c-87f1-a8b83718ac40 tempest-ProjectReaderTests-2023450681 None] Lock "cinder-270ff9f0-169a-4f02-b743-85f69c2d535d-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:18 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-24cfff19-9221-453b-a0e5-5d1f79b2953e tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf" returned: 0 in 0.284s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-24cfff19-9221-453b-a0e5-5d1f79b2953e tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:18 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.info Sep 10 18:39:18 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:18 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-24cfff19-9221-453b-a0e5-5d1f79b2953e tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.info" returned: 0 in 0.267s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:18 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-24cfff19-9221-453b-a0e5-5d1f79b2953e tempest-ProjectMemberTests-1340142452 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.info is being set with open permissions: ugo+rw Sep 10 18:39:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-24cfff19-9221-453b-a0e5-5d1f79b2953e tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:18 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.info Sep 10 18:39:18 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:18 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-24cfff19-9221-453b-a0e5-5d1f79b2953e tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.info" returned: 0 in 0.250s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:18 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-24cfff19-9221-453b-a0e5-5d1f79b2953e tempest-ProjectMemberTests-1340142452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:18 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-24cfff19-9221-453b-a0e5-5d1f79b2953e tempest-ProjectMemberTests-1340142452 None] Create snapshot completed successfully Sep 10 18:39:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-605fbcc3-e8b7-4035-99fd-5ab4f209c1bf-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] Lock "cinder-605fbcc3-e8b7-4035-99fd-5ab4f209c1bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-605fbcc3-e8b7-4035-99fd-5ab4f209c1bf" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:19 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-605fbcc3-e8b7-4035-99fd-5ab4f209c1bf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:19 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] Deleting offline snapshot 605fbcc3-e8b7-4035-99fd-5ab4f209c1bf of volume 403bf9ac-4c93-41e0-a2ff-e8baa95cac4d {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:39:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] snapshot_file for this snap is: volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:39:20 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9811a84-6970-4477-9078-33f60de4c725]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:20 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf Sep 10 18:39:20 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:20 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf" returned: 0 in 0.378s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:20 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:39:20 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[153b8db9-8802-45c5-be54-9ead2b7f022e]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:20 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d Sep 10 18:39:20 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:20 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d" returned: 0 in 0.354s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:20 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:20 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf Sep 10 18:39:20 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:21 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf" returned: 0 in 0.350s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:21 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf Sep 10 18:39:21 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:21 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:21 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d.605fbcc3-e8b7-4035-99fd-5ab4f209c1bf" returned: 0 in 0.249s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-605fbcc3-e8b7-4035-99fd-5ab4f209c1bf" released by "_delete_snapshot" :: held 1.437s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d" released by "delete_snapshot" :: held 1.461s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:21 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] Created reservations ['979cd3bd-d6a0-4949-b5ce-7f2948604727', 'e34797af-af6a-4898-a7ac-c12472f0a790', '9e5d381d-e016-452a-8950-f33dfee0b70d', 'b714188a-4445-4800-b9b2-fe5e6fc0df9b'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:39:21 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] Delete snapshot completed successfully. Sep 10 18:39:21 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-eedd3cff-8cda-4764-8f29-1346d119f62b tempest-ProjectMemberTests-1340142452 None] Lock "cinder-605fbcc3-e8b7-4035-99fd-5ab4f209c1bf-delete_snapshot" released by "delete_snapshot" :: held 1.607s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "cinder-quobyte-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d" acquired by "delete_volume" :: waited 0.019s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:22 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4236528-b5ec-4bba-82ca-f4d2304a1bce]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:22 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d Sep 10 18:39:22 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:22 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d" returned: 0 in 0.373s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:22 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d Sep 10 18:39:22 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:22 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d" returned: 0 in 0.246s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:22 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-quobyte-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d" released by "delete_volume" :: held 0.688s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:22 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] Created reservations ['bfdc5458-c201-4327-9871-cec9afdaa3b2', '3a02b7d5-ee39-4277-86e8-20bfaef8a67a', '0a964f5b-f826-43a7-bc0c-adb21826498e', 'e2b9abe1-3e10-46b0-9cfd-189affe294f7'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:39:22 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:UPDATE=287,cinder:SELECT=209,cinder:INSERT=79,cinder:DELETE=24 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:39:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:39:22 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:39:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:22 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:23 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:39:23 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:23 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:23 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.253s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:23 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:39:23 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] Deleted volume successfully. Sep 10 18:39:23 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-4982a984-d28d-4bd4-94e6-2f145d0cb769 tempest-ProjectMemberTests-1340142452 None] Lock "cinder-403bf9ac-4c93-41e0-a2ff-e8baa95cac4d-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:39:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:39:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:39:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:39:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:29 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:39:29 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:29 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.250s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:39:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:39:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 28 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:39:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 10 18:39:32 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:39:33 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=190,cinder:UPDATE=256,cinder:INSERT=62,cinder:DELETE=21 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Flow 'volume_create_manager' (205d2b38-8f48-4975-be61-3dc3e4f2c40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84234015-4c42-4d35-a5e6-51418766b3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84234015-4c42-4d35-a5e6-51418766b3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1300246486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01970ab4-d8e5-42f5-8b59-f329f34301a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0316f28ae13f442e938aa36095df25fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:39:52Z,use_quota=True,user_id='f6831073a8af4153ba48e685392b9301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12f868b-30b6-4701-876d-816b56085f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12f868b-30b6-4701-876d-816b56085f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd76983a-272e-4aa0-856a-afcd523f8c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd76983a-272e-4aa0-856a-afcd523f8c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01970ab4-d8e5-42f5-8b59-f329f34301a5', 'volume_name': 'volume-01970ab4-d8e5-42f5-8b59-f329f34301a5', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62107c25-45bc-4e9a-9a4a-ca548ac289ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62107c25-45bc-4e9a-9a4a-ca548ac289ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f08582d-bd0a-4909-b0b8-0f6c84071566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:51 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Volume 01970ab4-d8e5-42f5-8b59-f329f34301a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01970ab4-d8e5-42f5-8b59-f329f34301a5', 'volume_size': 1} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1300246486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01970ab4-d8e5-42f5-8b59-f329f34301a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0316f28ae13f442e938aa36095df25fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:39:52Z,use_quota=True,user_id='f6831073a8af4153ba48e685392b9301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)}" {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Creating volume 01970ab4-d8e5-42f5-8b59-f329f34301a5 {{(pid=87842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:39:51 devstack cinder-volume[87842]: INFO cinder.volume.drivers.remotefs [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] casted to osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 Sep 10 18:39:51 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 1073741824 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:52 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 1073741824 Sep 10 18:39:52 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:52 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 1073741824" returned: 0 in 0.411s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:52 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 Sep 10 18:39:52 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:52 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5" returned: 0 in 0.238s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:52 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'} {{(pid=87842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 10 18:39:52 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f08582d-bd0a-4909-b0b8-0f6c84071566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01970ab4-d8e5-42f5-8b59-f329f34301a5', 'volume_size': 1}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0287014b-c1d2-4f68-a89b-951db8a42285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:52 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Volume volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 (01970ab4-d8e5-42f5-8b59-f329f34301a5): created successfully Sep 10 18:39:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0287014b-c1d2-4f68-a89b-951db8a42285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:52 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Flow 'volume_create_manager' (205d2b38-8f48-4975-be61-3dc3e4f2c40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:39:52 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-cc99ae22-2ac8-4f4f-a8ba-043d874fad92 tempest-SnapshotDependencyTests-1986389522 None] Created volume successfully. Sep 10 18:39:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9266533f-c3c4-4c6b-8ad5-7601805bb60d tempest-SnapshotDependencyTests-1986389522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9266533f-c3c4-4c6b-8ad5-7601805bb60d tempest-SnapshotDependencyTests-1986389522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:53 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-9266533f-c3c4-4c6b-8ad5-7601805bb60d tempest-SnapshotDependencyTests-1986389522 None] Creating offline snapshot a8101c2f-5f51-4c85-ab33-a36f1a226521 of volume 01970ab4-d8e5-42f5-8b59-f329f34301a5 {{(pid=87842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 10 18:39:53 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2fc835-1acc-4c34-9d30-44449ef9bf47]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9266533f-c3c4-4c6b-8ad5-7601805bb60d tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:53 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 Sep 10 18:39:53 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:53 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9266533f-c3c4-4c6b-8ad5-7601805bb60d tempest-SnapshotDependencyTests-1986389522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5" returned: 0 in 0.354s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9266533f-c3c4-4c6b-8ad5-7601805bb60d tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521 1G {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:53 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521 1G Sep 10 18:39:53 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:53 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9266533f-c3c4-4c6b-8ad5-7601805bb60d tempest-SnapshotDependencyTests-1986389522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521 1G" returned: 0 in 0.375s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:53 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9266533f-c3c4-4c6b-8ad5-7601805bb60d tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:53 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521 Sep 10 18:39:53 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:54 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9266533f-c3c4-4c6b-8ad5-7601805bb60d tempest-SnapshotDependencyTests-1986389522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 -F qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521" returned: 0 in 0.289s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:54 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-9266533f-c3c4-4c6b-8ad5-7601805bb60d tempest-SnapshotDependencyTests-1986389522 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521 is being set with open permissions: ugo+rw Sep 10 18:39:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9266533f-c3c4-4c6b-8ad5-7601805bb60d tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:54 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521 Sep 10 18:39:54 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:54 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9266533f-c3c4-4c6b-8ad5-7601805bb60d tempest-SnapshotDependencyTests-1986389522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521" returned: 0 in 0.235s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9266533f-c3c4-4c6b-8ad5-7601805bb60d tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:54 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.info Sep 10 18:39:54 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:54 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9266533f-c3c4-4c6b-8ad5-7601805bb60d tempest-SnapshotDependencyTests-1986389522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.info" returned: 0 in 0.243s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:54 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-9266533f-c3c4-4c6b-8ad5-7601805bb60d tempest-SnapshotDependencyTests-1986389522 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.info is being set with open permissions: ugo+rw Sep 10 18:39:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9266533f-c3c4-4c6b-8ad5-7601805bb60d tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.info {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:54 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.info Sep 10 18:39:54 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:54 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-9266533f-c3c4-4c6b-8ad5-7601805bb60d tempest-SnapshotDependencyTests-1986389522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.info" returned: 0 in 0.240s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:54 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-9266533f-c3c4-4c6b-8ad5-7601805bb60d tempest-SnapshotDependencyTests-1986389522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.819s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:54 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-9266533f-c3c4-4c6b-8ad5-7601805bb60d tempest-SnapshotDependencyTests-1986389522 None] Create snapshot completed successfully Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.volume.flows.manager.create_volume [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Flow 'volume_create_manager' (2b55eba1-1b41-4ef8-8673-3cd5e2da48d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809e9d8c-56ee-4faa-a5cd-90577911c304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809e9d8c-56ee-4faa-a5cd-90577911c304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-10T16:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc83542a-7371-431f-9288-a916005f95b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0316f28ae13f442e938aa36095df25fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-10T16:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a8101c2f-5f51-4c85-ab33-a36f1a226521,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-10T16:39:56Z,use_quota=True,user_id='f6831073a8af4153ba48e685392b9301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be37fb35-e179-4df7-90d3-8dc5157ddeca),volume_type_id=be37fb35-e179-4df7-90d3-8dc5157ddeca)' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225e1631-77cb-4de4-9822-76f7746d12d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225e1631-77cb-4de4-9822-76f7746d12d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c9a7ac-19c6-4b5d-8cba-3e615f9a2096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c9a7ac-19c6-4b5d-8cba-3e615f9a2096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fc83542a-7371-431f-9288-a916005f95b8', 'volume_name': 'volume-fc83542a-7371-431f-9288-a916005f95b8', 'volume_size': 1, 'snapshot_id': 'a8101c2f-5f51-4c85-ab33-a36f1a226521'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab805331-8927-47b4-84f8-6cfbe23e8e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab805331-8927-47b4-84f8-6cfbe23e8e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4fa22b0-eee6-49ca-8363-bac464847765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:39:55 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Volume fc83542a-7371-431f-9288-a916005f95b8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fc83542a-7371-431f-9288-a916005f95b8', 'volume_size': 1, 'snapshot_id': 'a8101c2f-5f51-4c85-ab33-a36f1a226521'} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Acquiring lock "cinder-quobyte-a8101c2f-5f51-4c85-ab33-a36f1a226521-fc83542a-7371-431f-9288-a916005f95b8" by "_create_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Lock "cinder-quobyte-a8101c2f-5f51-4c85-ab33-a36f1a226521-fc83542a-7371-431f-9288-a916005f95b8" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Creating volume fc83542a-7371-431f-9288-a916005f95b8 from snapshot a8101c2f-5f51-4c85-ab33-a36f1a226521 {{(pid=87842) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Selected osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14 as target Quobyte volume. {{(pid=87842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Acquiring lock "cinder-quobyte-fc83542a-7371-431f-9288-a916005f95b8" by "_copy_volume_from_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Lock "cinder-quobyte-fc83542a-7371-431f-9288-a916005f95b8" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] snapshot: a8101c2f-5f51-4c85-ab33-a36f1a226521, volume: fc83542a-7371-431f-9288-a916005f95b8, {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d96cb9f-8ff1-416f-aab7-2c5e026ca48c]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:55 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:56 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521 Sep 10 18:39:56 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:56 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521" returned: 0 in 0.351s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01970ab4-d8e5-42f5-8b59-f329f34301a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:39:56 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b36e94b-9465-4b09-8a80-05ca16de8c38]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:39:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:56 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 Sep 10 18:39:56 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:39:56 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Sep 10 18:39:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5" returned: 0 in 0.358s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:39:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 10 18:39:56 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Creating direct copy from snapshot {{(pid=87842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 10 18:39:56 devstack cinder-volume[87842]: DEBUG cinder.utils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Path /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc83542a-7371-431f-9288-a916005f95b8 not found in is_blk_device check {{(pid=87842) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 10 18:39:56 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc83542a-7371-431f-9288-a916005f95b8 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:39:56 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc83542a-7371-431f-9288-a916005f95b8 Sep 10 18:39:56 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:40:00 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Sep 10 18:40:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc83542a-7371-431f-9288-a916005f95b8" returned: 0 in 4.029s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:40:00 devstack cinder-volume[87842]: DEBUG cinder.image.image_utils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Image conversion details: src /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5, size 1024.00 MB, duration 4.03 sec, destination /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc83542a-7371-431f-9288-a916005f95b8 {{(pid=87842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 10 18:40:00 devstack cinder-volume[87842]: INFO cinder.image.image_utils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Converted 1024.00 MB image at 254.09 MB/s Sep 10 18:40:00 devstack cinder-volume[87842]: WARNING cinder.volume.drivers.remotefs [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc83542a-7371-431f-9288-a916005f95b8 is being set with open permissions: ugo+rw Sep 10 18:40:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc83542a-7371-431f-9288-a916005f95b8 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:40:00 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc83542a-7371-431f-9288-a916005f95b8 Sep 10 18:40:00 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:40:00 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 10 18:40:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc83542a-7371-431f-9288-a916005f95b8" returned: 0 in 0.235s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:40:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Lock "cinder-quobyte-fc83542a-7371-431f-9288-a916005f95b8" released by "_copy_volume_from_snapshot" :: held 5.041s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:40:00 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Lock "cinder-quobyte-a8101c2f-5f51-4c85-ab33-a36f1a226521-fc83542a-7371-431f-9288-a916005f95b8" released by "_create_volume_from_snapshot" :: held 5.097s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:40:00 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.113s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:40:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4fa22b0-eee6-49ca-8363-bac464847765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc83542a-7371-431f-9288-a916005f95b8', 'volume_size': 1, 'snapshot_id': 'a8101c2f-5f51-4c85-ab33-a36f1a226521'}' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:40:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601caefb-c049-4ff5-837d-138a78ad77e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 10 18:40:00 devstack cinder-volume[87842]: INFO cinder.volume.flows.manager.create_volume [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Volume volume-fc83542a-7371-431f-9288-a916005f95b8 (fc83542a-7371-431f-9288-a916005f95b8): created successfully Sep 10 18:40:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601caefb-c049-4ff5-837d-138a78ad77e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 10 18:40:00 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Flow 'volume_create_manager' (2b55eba1-1b41-4ef8-8673-3cd5e2da48d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 10 18:40:01 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-862685ad-7258-495f-814f-9b30a2396425 tempest-SnapshotDependencyTests-1986389522 None] Created volume successfully. Sep 10 18:40:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] Acquiring lock "cinder-a8101c2f-5f51-4c85-ab33-a36f1a226521-delete_snapshot" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:40:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] Lock "cinder-a8101c2f-5f51-4c85-ab33-a36f1a226521-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:40:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] Acquiring lock "cinder-quobyte-01970ab4-d8e5-42f5-8b59-f329f34301a5" by "delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:40:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] Lock "cinder-quobyte-01970ab4-d8e5-42f5-8b59-f329f34301a5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:40:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] Acquiring lock "cinder-quobyte-a8101c2f-5f51-4c85-ab33-a36f1a226521" by "_delete_snapshot" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:40:01 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] Lock "cinder-quobyte-a8101c2f-5f51-4c85-ab33-a36f1a226521" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:40:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] Deleting offline snapshot a8101c2f-5f51-4c85-ab33-a36f1a226521 of volume 01970ab4-d8e5-42f5-8b59-f329f34301a5 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 10 18:40:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] snapshot_file for this snap is: volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521 {{(pid=87842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 10 18:40:01 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a8be14-46ce-4e2d-982f-29bd97416013]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:40:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:40:01 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521 Sep 10 18:40:01 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:40:01 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Sep 10 18:40:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521" returned: 0 in 0.343s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:40:01 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.remotefs [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01970ab4-d8e5-42f5-8b59-f329f34301a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 10 18:40:01 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ddee6e-900e-43d0-b9ce-cea9754d80de]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:40:01 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:40:01 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 Sep 10 18:40:01 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:40:02 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 10 18:40:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5" returned: 0 in 0.509s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:40:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:40:02 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521 Sep 10 18:40:02 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:40:02 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 10 18:40:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521" returned: 0 in 0.323s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:40:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:40:02 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521 Sep 10 18:40:02 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:40:02 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 10 18:40:02 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5.a8101c2f-5f51-4c85-ab33-a36f1a226521" returned: 0 in 0.231s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:40:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] Lock "cinder-quobyte-a8101c2f-5f51-4c85-ab33-a36f1a226521" released by "_delete_snapshot" :: held 1.498s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:40:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] Lock "cinder-quobyte-01970ab4-d8e5-42f5-8b59-f329f34301a5" released by "delete_snapshot" :: held 1.528s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:40:02 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] Created reservations ['e3c97a4c-8c9f-4ce8-ad80-59c56f16569f', '5c690854-daa9-4b5c-bdac-fe289acf26ba', 'ed22b896-3a77-4d4e-bf10-cc1c8fd8c008', '9719bd82-7d10-4900-ab6d-f0a13da286ff'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:40:02 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] Delete snapshot completed successfully. Sep 10 18:40:02 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-5187175b-27d9-4531-8398-7bccb438b97b tempest-SnapshotDependencyTests-1986389522 None] Lock "cinder-a8101c2f-5f51-4c85-ab33-a36f1a226521-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:40:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] Acquiring lock "cinder-01970ab4-d8e5-42f5-8b59-f329f34301a5-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:40:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] Lock "cinder-01970ab4-d8e5-42f5-8b59-f329f34301a5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:40:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] Acquiring lock "cinder-quobyte-01970ab4-d8e5-42f5-8b59-f329f34301a5" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:40:03 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] Lock "cinder-quobyte-01970ab4-d8e5-42f5-8b59-f329f34301a5" acquired by "delete_volume" :: waited 0.012s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:40:03 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[995c6ab9-d72b-4087-ba29-5eff28bdd413]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:40:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:40:03 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 Sep 10 18:40:03 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:40:03 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Sep 10 18:40:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5" returned: 0 in 0.344s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:40:03 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:40:03 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5 Sep 10 18:40:03 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:40:04 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Sep 10 18:40:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-01970ab4-d8e5-42f5-8b59-f329f34301a5" returned: 0 in 0.249s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:40:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] Lock "cinder-quobyte-01970ab4-d8e5-42f5-8b59-f329f34301a5" released by "delete_volume" :: held 0.646s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:40:04 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] Created reservations ['43b368bd-a3d6-43c6-b14e-0feb8b3e7bdc', 'bc02cdef-00eb-409c-8560-51a08a654172', 'adf59283-fcb4-47d8-839b-f7b619a9cbe6', '71cba81d-3941-4f9f-bc47-b2e40becf55e'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:40:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:40:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:40:04 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:40:04 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:40:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:40:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:40:04 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:40:04 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:40:04 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Sep 10 18:40:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.255s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:40:04 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:40:04 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] Deleted volume successfully. Sep 10 18:40:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-8dedddaa-d7ee-4b89-8bfe-d07e660e472f tempest-SnapshotDependencyTests-1986389522 None] Lock "cinder-01970ab4-d8e5-42f5-8b59-f329f34301a5-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:40:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] Acquiring lock "cinder-fc83542a-7371-431f-9288-a916005f95b8-delete_volume" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:40:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] Lock "cinder-fc83542a-7371-431f-9288-a916005f95b8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:40:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] Acquiring lock "cinder-quobyte-fc83542a-7371-431f-9288-a916005f95b8" by "delete_volume" {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 10 18:40:04 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] Lock "cinder-quobyte-fc83542a-7371-431f-9288-a916005f95b8" acquired by "delete_volume" :: waited 0.015s {{(pid=87842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 10 18:40:04 devstack cinder-volume[87842]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f4e016-b8f8-40cc-aedf-f2026c1908ea]: (4, 'qcow2') {{(pid=89425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 10 18:40:04 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc83542a-7371-431f-9288-a916005f95b8 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:40:04 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc83542a-7371-431f-9288-a916005f95b8 Sep 10 18:40:04 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:40:05 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 10 18:40:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc83542a-7371-431f-9288-a916005f95b8" returned: 0 in 0.344s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:40:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc83542a-7371-431f-9288-a916005f95b8 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:40:05 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc83542a-7371-431f-9288-a916005f95b8 Sep 10 18:40:05 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:40:05 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 10 18:40:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503/volume-fc83542a-7371-431f-9288-a916005f95b8" returned: 0 in 0.239s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:40:05 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] Lock "cinder-quobyte-fc83542a-7371-431f-9288-a916005f95b8" released by "delete_volume" :: held 0.620s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:40:05 devstack cinder-volume[87842]: DEBUG cinder.quota [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] Created reservations ['7bd35cb6-cb3a-4002-8ee0-ebcf2fdd7ca6', '030d39fb-e110-4b33-ae4e-e18482d41001', '861e97f1-3cb2-4be2-8916-851c4f1818d2', '8e06f605-f6eb-4185-803f-a5d4ec7324d3'] {{(pid=87842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 18:40:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:40:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:40:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:40:05 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:40:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:40:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:40:05 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:40:05 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:40:05 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 10 18:40:05 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.240s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:40:05 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:40:05 devstack cinder-volume[87842]: INFO cinder.volume.manager [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] Deleted volume successfully. Sep 10 18:40:05 devstack cinder-volume[87842]: DEBUG cinder.coordination [None req-97b3f307-dd65-4e97-abcf-a234b8eda314 tempest-SnapshotDependencyTests-1986389522 None] Lock "cinder-fc83542a-7371-431f-9288-a916005f95b8-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 10 18:40:15 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:SELECT=28,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=7 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:40:15 devstack cinder-volume[87842]: DEBUG dbcounter [-] [87842] Writing DB stats cinder:UPDATE=29,cinder:SELECT=21,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 10 18:40:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:40:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 10 18:40:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 10 18:40:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14': None} {{(pid=87842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 10 18:40:29 devstack cinder-volume[87842]: DEBUG cinder.volume.drivers.quobyte [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b61ad6a3-5e73-4ddd-9b2a-8722b740ca14'] {{(pid=87842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 10 18:40:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.lockutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 10 18:40:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 10 18:40:29 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503 Sep 10 18:40:29 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 18:40:29 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 10 18:40:29 devstack cinder-volume[87842]: DEBUG oslo_concurrency.processutils [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d48143a829cd9092adca71bf62bb6503" returned: 0 in 0.239s {{(pid=87842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 10 18:40:29 devstack cinder-volume[87842]: DEBUG cinder.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Notifying Schedulers of capabilities ... {{(pid=87842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 10 18:40:29 devstack cinder-volume[87842]: DEBUG oslo_service.periodic_task [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] Running periodic task VolumeManager._thread_info {{(pid=87842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 10 18:40:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread count: 28 {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 10 18:40:29 devstack cinder-volume[87842]: DEBUG cinder.volume.manager [None req-12a9be86-9cab-49c0-a6bb-fef5d491f183 None None] thread info: [<_MainThread(MainThread, started 132110577377408)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}